-- Logs begin at Wed 2022-08-24 12:47:09 UTC, end at Wed 2022-08-24 13:59:18 UTC. -- Aug 24 13:29:24.192727 dv-cinder-779578-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 13:29:24.204331 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 13:29:24.204889 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 13:29:24 2022] *** Aug 24 13:29:24.204889 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 13:29:24.204889 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 13:29:24.204889 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: nodename: dv-cinder-779578-4-iscsi Aug 24 13:29:24.204889 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: machine: x86_64 Aug 24 13:29:24.204889 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: clock source: unix Aug 24 13:29:24.204889 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: pcre jit disabled Aug 24 13:29:24.204889 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: detected number of CPU cores: 4 Aug 24 13:29:24.204889 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: current working directory: / Aug 24 13:29:24.204889 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: detected binary path: /usr/bin/uwsgi-core Aug 24 13:29:24.204889 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: your processes number limit is 47680 Aug 24 13:29:24.204889 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: your memory page size is 4096 bytes Aug 24 13:29:24.204889 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: detected max file descriptor number: 2048 Aug 24 13:29:24.204889 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: lock engine: pthread robust mutexes Aug 24 13:29:24.204889 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: thunder lock: enabled Aug 24 13:29:24.204889 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 13:29:24.204889 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 13:29:24.243894 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: Python main interpreter initialized at 0x55ce47d5a9c0 Aug 24 13:29:24.243894 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: python threads support enabled Aug 24 13:29:24.243894 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: your server socket listen backlog is limited to 100 connections Aug 24 13:29:24.243894 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: your mercy for graceful operations on workers is 90 seconds Aug 24 13:29:24.244320 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 13:29:24.244398 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: *** Operational MODE: preforking *** Aug 24 13:29:24.244626 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: *** uWSGI is running in multiple interpreter mode *** Aug 24 13:29:24.244626 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: spawned uWSGI master process (pid: 106199) Aug 24 13:29:24.244845 dv-cinder-779578-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 13:29:24.246265 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: spawned uWSGI worker 1 (pid: 106200, cores: 1) Aug 24 13:29:24.246265 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: spawned uWSGI worker 2 (pid: 106201, cores: 1) Aug 24 13:29:24.246265 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 13:29:24.911348 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 13:29:24.940505 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 13:29:26.011399 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 13:29:26.011399 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: from cryptography.utils import int_from_bytes Aug 24 13:29:26.012033 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 13:29:26.012033 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: from cryptography.utils import int_from_bytes Aug 24 13:29:26.058652 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 13:29:26.058652 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: from cryptography.utils import int_from_bytes Aug 24 13:29:26.059277 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 13:29:26.059277 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: from cryptography.utils import int_from_bytes Aug 24 13:29:28.566652 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 13:29:28.567320 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 13:29:28.567422 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 13:29:28.567770 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 13:29:28.568021 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 13:29:28.568427 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.568751 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.569069 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.569384 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.569710 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.570331 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.570331 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.570642 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.570963 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.571220 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.571700 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.571853 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-779578-4-iscsi {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.572169 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.572501 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.572809 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.573121 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.573468 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.573836 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.574029 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.574779 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.574971 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.575362 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.575624 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.575920 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.576255 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.576564 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.576881 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.577193 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.577507 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.578469 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 13:29:28.579002 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.579142 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 13:29:28.579268 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-779578-4-iscsi {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.579351 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 13:29:28.579481 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.579601 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 13:29:28.579767 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.579853 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 13:29:28.580084 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.580262 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.580528 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.580671 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.580841 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.580926 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.581148 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.581236 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.581466 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.581567 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.581787 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.581886 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.582093 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.582184 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.582416 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.582512 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.582734 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.582815 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.583021 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.583113 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.583342 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.583435 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.583638 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.583728 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-779578-4-iscsi {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.583943 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.584027 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.584272 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.584362 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.584627 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.584766 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.584930 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.585103 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.585305 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.585404 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.585535 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.585729 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.585831 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.586040 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.586126 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.586378 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.586550 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.586694 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.586867 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.586960 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.587172 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.587257 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.587486 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.587580 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.587800 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.587920 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.588100 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.588265 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.588427 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.588581 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.588728 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.588905 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.589028 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.589220 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.589313 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.589551 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.589643 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.589861 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.589946 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.590186 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.590283 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-779578-4-iscsi {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.590498 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.590675 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.590806 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.590991 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.591119 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.591308 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.591421 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.591861 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.591975 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.592057 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.592150 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.592369 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.592465 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.593069 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.593174 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.593258 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.593383 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.593699 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.593791 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.593922 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.594020 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.594147 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.594229 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.594385 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.594612 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.594704 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.594831 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.595006 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.595134 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.595317 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.595463 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.595632 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.595744 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.595954 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.596077 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.596287 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.596420 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.596602 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.596695 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.596861 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.596958 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.597172 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.597267 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.597498 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.597599 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.597816 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.597916 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.598118 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.598221 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.598384 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.598476 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.598635 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.598730 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.598957 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.599060 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.599270 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.599370 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.599570 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.599663 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.599869 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.599962 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.600169 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.600287 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.600488 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.600601 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.600789 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.600882 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.601087 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.601191 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.601397 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.601539 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.601695 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.601786 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.602009 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.602145 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.602312 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.602406 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.602613 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.602701 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.602912 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.603025 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.603212 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.603366 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.603519 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.603712 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.603837 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.603922 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.604102 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.604236 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.604440 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.604530 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.604741 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.604825 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.605039 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.605132 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.605354 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.605441 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.605655 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.605739 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.605956 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.606049 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.606269 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.606360 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.606575 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.606698 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.606872 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.606982 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.607183 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.607266 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.607488 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.607648 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.607788 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.607896 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.608084 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.608219 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.608408 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.608533 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.608707 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.608930 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.609080 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.609249 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.609527 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.609618 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.609831 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.609919 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.610126 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.610210 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.610440 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.610530 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.610755 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.610887 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.611061 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.611145 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.611363 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.611450 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.611663 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.611751 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.611976 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.612060 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.612328 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.612415 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.612641 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.612727 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.612949 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.613039 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.613283 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.613377 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.613613 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.613742 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.613943 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.614035 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.614261 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.614354 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.614573 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.614657 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.614879 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.614973 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.615200 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.615291 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.615504 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.615593 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.615812 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.615893 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.616122 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.616284 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.616562 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.616783 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.616783 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.616943 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.617102 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.617210 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.617411 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.617542 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.617733 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.617875 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.618025 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.618148 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.618319 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.618404 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.618624 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.618708 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.618949 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.619073 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.619255 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.619343 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.619562 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.619645 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.619871 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.619971 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.620198 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.620285 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.620510 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.620605 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.620826 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.620956 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.621127 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.621212 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.621435 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.621546 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.621740 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.621885 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.622057 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.622198 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.622372 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.622469 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.622682 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.622776 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.622996 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.623108 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.623300 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.623398 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.623606 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.623699 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:29:28.623920 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.624060 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.624243 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.624346 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.625087 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.625233 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.625389 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.625727 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.626049 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.626174 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.626355 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.626470 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.626664 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.626813 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.626975 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.627142 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.627282 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.627463 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.627588 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.627784 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.627879 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.628116 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.628233 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.628463 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.628560 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.628781 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.628880 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.629085 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.629169 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.629386 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.629491 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.629708 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.629870 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.630016 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.630133 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.630317 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.630401 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.630646 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.630746 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.630950 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.631046 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.631256 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.631340 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.631562 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.631655 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.631867 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.631955 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.632168 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.632331 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.632503 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.632646 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.632807 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.633260 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.633347 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.633478 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.633576 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.633656 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.633733 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.633957 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.634042 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.634285 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.634386 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.634586 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.634677 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.634888 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.634972 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.635200 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.635292 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.635507 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.635600 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.635811 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.635895 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.636122 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.636269 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.636456 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.636540 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.636778 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.636904 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.637088 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.637224 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.637395 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.637541 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.637726 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.637856 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.638053 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.638172 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.638355 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.638517 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.638678 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.638836 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.638998 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.639237 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.639320 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.639560 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.639647 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.639882 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.639968 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.640772 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.640902 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.641190 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.641337 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.641539 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.641689 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.641848 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.641936 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.642151 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.642233 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.642459 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.642548 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.642766 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.642858 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.643079 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.643205 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.643378 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.643465 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.643704 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.643795 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.644020 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.644319 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.644464 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.644590 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.644677 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.644755 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.644935 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.645030 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.645280 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.645413 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.645586 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.645676 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.645895 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.645998 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.646213 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.646305 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.646536 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.646668 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.646848 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.646993 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.647167 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.647260 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.647485 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.647625 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.647799 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.647942 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.648140 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.648364 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.648465 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.648545 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.648732 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.648819 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.649049 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.649150 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.649359 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.649450 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.649676 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.649821 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.649988 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.650093 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.650300 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.650384 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.650607 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.650699 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.650929 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.651021 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.651232 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.651325 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.651547 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.651631 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.651892 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.651984 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.652226 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.652363 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.652558 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.652705 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.652882 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.652975 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.653204 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.653300 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.653513 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.653603 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.653825 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.653911 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.654134 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.654385 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.654477 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.654543 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.654738 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.654822 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.655048 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.655143 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.655354 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.655437 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.655662 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.655766 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.656004 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.656153 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.656344 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.656521 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.656661 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.656747 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.656990 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.657078 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.657293 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.657377 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.657597 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.657680 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.657904 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.657997 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.658209 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.658294 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.658532 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.658615 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.658842 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.658936 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.659186 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.659270 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.659522 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.659615 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.659828 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.659918 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.660135 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.660262 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.660465 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.660560 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.660797 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.660888 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.661115 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.661199 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.661433 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.661530 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.661739 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.661822 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.662051 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.662135 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.662370 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.662530 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.662680 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.662830 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.662985 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.663101 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.663287 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.663388 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.663589 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.663673 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.663898 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.663983 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.664234 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.664364 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.664545 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.664634 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.664862 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.664949 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.665180 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.665272 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.665480 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.665576 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.665781 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.665877 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.666104 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.666190 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.666408 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.666537 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.666708 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.666792 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.667009 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.667102 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.667309 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.667393 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.667649 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.667741 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.667955 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.668041 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.668293 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.668428 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.668608 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.668715 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.668921 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.669012 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.669228 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.669313 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.669540 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.669632 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.669848 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.669934 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.670154 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.670238 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.670459 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.670550 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.670770 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.670869 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.671074 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.671158 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.671920 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.672053 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.672280 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.672408 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.672592 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.672680 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.672917 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.673002 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.673231 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.673323 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.673546 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.673636 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.673858 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.673944 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.674165 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.674249 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.674473 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.674561 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.674786 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.674873 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.675099 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.675191 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.675410 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.675682 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.675776 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.676015 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.676100 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.676356 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.676458 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.676672 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.676759 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.676982 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.677074 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.677290 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.677375 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.677604 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.677691 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.677925 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.678007 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.678236 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.678346 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.678555 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.678656 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.678864 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.678956 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.679424 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.679522 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.679723 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.679816 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.680031 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.680123 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.680356 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.680443 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.680659 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.680754 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.680961 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.681046 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.681266 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.681351 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.681567 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.681664 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.681867 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.681951 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.682166 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.682251 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.682466 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.682596 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.682777 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.682861 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.683077 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.683160 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.683383 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.683481 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.683681 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.683764 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.683999 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.684084 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.684327 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.684416 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.684629 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.684714 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.684931 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.685027 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.685232 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.685316 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.685572 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.685665 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.685876 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.685970 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.686187 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.686272 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.686516 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.686600 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.686830 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.686926 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.687199 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.687323 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.687513 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.687599 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.687922 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.688006 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.688253 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.688341 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.688560 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.688655 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.688862 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.689171 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.689265 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.689477 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.689569 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.689777 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.689871 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.690084 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.690169 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.690390 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.690474 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.690696 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.690789 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.691003 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.691089 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.691300 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.691383 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.691606 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.691700 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.691907 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.692001 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.692238 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.692328 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.692547 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.692674 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.692848 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.692935 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.693147 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.693230 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.693452 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.693549 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.693754 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.693839 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.694054 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.694137 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.694359 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.694451 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.694657 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.694748 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.694971 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.695055 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.695272 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.695369 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.695571 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.695655 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.695872 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.695963 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.696190 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.696289 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.696508 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.696594 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.696808 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.696892 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.697128 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.697214 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.697435 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.697531 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.697734 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.697818 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.698035 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.698131 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.698339 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.698423 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.698636 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.698720 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.698937 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.699030 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.699244 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.699330 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.699565 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.699650 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.699877 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.699963 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.700195 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.700282 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.700502 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.700603 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.700802 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.700909 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.701101 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.701217 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.701399 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.701526 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.701703 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.701833 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.702000 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.702146 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.702298 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.702457 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.703115 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.703303 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.703428 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.703729 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.703835 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.704050 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.704158 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.704376 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.704463 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.704677 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.704775 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.704978 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.705063 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.705277 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.705360 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.705600 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.705700 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.705904 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.705989 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.706223 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.706322 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.706527 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.706622 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.706834 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.706960 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.707147 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.707239 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.707453 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.707637 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.707757 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.707844 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.708065 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.708161 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.708395 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.708480 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.708688 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.708809 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.708992 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.709078 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.709295 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.709387 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.709593 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.709676 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.709892 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.709975 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.710203 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.710288 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.710505 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.710595 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.710809 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.710893 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.711125 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.711211 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.711438 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.711521 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.711748 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.711841 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.712046 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.712131 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.712373 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.712460 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.712680 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.712775 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.712981 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.713072 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.713284 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.713377 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.713590 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.713684 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.713898 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.713983 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.714579 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.714690 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.714690 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.714952 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.715041 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.715119 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.715196 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.715273 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.715390 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.715482 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.715850 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.715942 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.716022 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.716114 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.716300 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.716419 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.716610 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.716748 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.717700 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.717818 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.719396 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.721768 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.721864 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.721958 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.722043 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.722113 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.722195 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.722285 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.722365 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.722442 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.722518 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.722610 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.722689 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.722774 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.722859 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.722927 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.723003 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.723089 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.723168 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.723233 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.723297 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.723471 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.723559 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.723635 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.723702 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.723782 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.723858 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.723943 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.724020 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.724110 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.724204 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.724286 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.724374 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.724454 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.724518 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.724591 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.724668 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.724733 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.724804 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.724889 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.724976 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.725043 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.725107 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.725178 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.725263 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.725348 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.725436 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.725521 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.725599 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.725683 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.725761 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.725837 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.725923 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.726003 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.726080 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.726163 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.726339 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.726477 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.726651 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.726794 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.726963 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.727100 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.727276 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.727512 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.727600 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.727907 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.728018 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.728133 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.728238 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.728477 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.728573 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.728798 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.728883 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.729180 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.729284 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.729426 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.729555 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.729737 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.729822 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.730045 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.730124 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.730443 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.730546 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.730756 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.730847 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.730957 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.731055 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.731268 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.731353 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.731571 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.731664 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.731883 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.731978 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.732231 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.732323 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.732524 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.732656 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.732843 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.732971 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.733255 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.733340 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.733576 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.733674 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.733934 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.734029 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.734275 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.734601 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.734795 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.734904 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.735123 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.735219 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.735449 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.735542 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.735760 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.735845 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.736077 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.736169 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.736426 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.736547 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.736736 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.736823 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.737044 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.737130 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.737350 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.737438 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.737657 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.737752 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.737959 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.738091 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.738260 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.738348 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.738580 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.738673 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.738884 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.738970 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.739199 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.739287 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.739507 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.739591 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.739821 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.739914 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.740136 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.740254 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.740463 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.740580 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.740781 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.740879 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.741090 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.741185 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.741390 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.741604 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.741697 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.741922 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.742010 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.742238 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.742324 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.742566 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.742653 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.742893 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.742987 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.743220 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.743304 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.743529 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.743672 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.743902 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.744031 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.744147 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.744283 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.744496 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.744624 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.744812 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.744925 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.745128 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.745242 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.745447 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.745568 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.745894 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.746027 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.746135 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.746250 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.746368 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.746484 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.746640 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.747208 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.747331 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.747439 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.747555 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.747664 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.747923 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.748170 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.748374 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.748492 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.748653 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.748770 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.749508 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.749593 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.749662 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.749737 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.749806 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.749877 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.749943 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.749943 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.750135 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.750261 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.750381 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.750501 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.750645 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.750797 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.750960 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.751113 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.751205 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.751285 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.751364 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.751443 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.751664 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.751755 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.751980 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.752067 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.752319 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.752410 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.752634 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.752723 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.752965 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.753051 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.753275 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.753361 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.753597 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.753768 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.753913 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.754000 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.754226 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.754373 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.754536 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.754623 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.754843 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.754929 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.755155 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.755326 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.755546 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.755647 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.755781 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.756038 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.756125 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.756401 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.756511 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.756810 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.756914 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.757026 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.757114 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.757338 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.757427 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.757649 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.757748 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.757960 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.758055 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.758269 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.758357 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.758578 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.758664 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.758885 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.759024 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.759192 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.759286 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.759517 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.759603 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.759838 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.759932 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.760160 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.760320 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.760492 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.760578 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.760809 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.760896 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.761713 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.761823 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.761823 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.761960 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.762061 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.762143 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.762143 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.762275 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.762345 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.762495 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.762609 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.762697 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.762917 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.763007 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.763244 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.763339 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.763553 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.763684 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.763861 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.763949 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.764171 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.764305 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.764571 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.764677 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.764804 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.764900 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.765784 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.765965 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.766123 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.766272 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.766423 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.766598 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.766762 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.766917 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.767009 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.767248 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.767336 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.767567 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.767728 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.767876 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.767966 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.768201 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.768315 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.768519 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.768620 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.768849 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.769058 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.769189 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.769374 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.769505 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.769711 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.769856 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.770012 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.770101 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.770340 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.770506 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.770647 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.770782 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.770947 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.771078 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.771269 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.771544 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.771633 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.771865 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.771985 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.772165 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.772274 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.772497 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.772587 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.772798 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.772885 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.773116 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.773211 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.773424 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.773533 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.773725 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.773884 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.774038 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.774134 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.774342 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.774427 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.774656 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.774877 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.774971 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.775224 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.775311 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.775930 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.776049 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.776142 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.776285 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.776385 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.776469 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.776545 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.776612 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.776899 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.777132 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.777221 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.777297 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.777406 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.777550 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.777710 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.777840 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.778027 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.778152 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.778336 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.778469 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.778638 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.778790 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.779361 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.779619 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.779943 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.780265 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.780582 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.781512 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.781842 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.782152 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.782463 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.782766 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.783079 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.783385 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.784127 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.784127 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.784325 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.784612 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.784918 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.785233 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.785534 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.785842 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.786147 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.786456 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.786765 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.787078 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.787176 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.787388 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.787486 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.787738 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.787828 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.788063 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.788241 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.788377 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.788479 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.788704 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.788806 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.789010 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.789131 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.789321 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.789574 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.789677 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.789978 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.790739 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.791082 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.791225 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.791409 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.791754 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.792087 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.792421 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.792651 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.792751 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.793027 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.793169 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.793483 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.793640 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.793738 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.793960 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.794162 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.794272 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.794582 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.794676 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.794892 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.795136 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.795227 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.795501 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.795811 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.796088 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.796165 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.797041 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.797229 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.797356 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.797668 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.797877 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.797980 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.798349 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.798497 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.798666 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.799012 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.799098 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.799331 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.799633 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.799734 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.799969 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.800141 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.800350 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.800666 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.800756 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.800977 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.801277 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.801354 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.801584 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.801877 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.801966 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.802216 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.802490 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.802589 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.802820 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.803075 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.803247 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.803556 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.803688 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.803876 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.804479 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.804575 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.804790 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.805112 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.805198 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.805434 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.805721 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.805799 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.806050 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.806341 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.806434 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.806676 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.806873 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.807017 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.807345 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.807684 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.807791 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.807963 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.808119 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.808299 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.808609 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.808696 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.808971 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.809092 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.809291 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.809548 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.809653 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.809926 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.810116 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.810226 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.810536 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.810671 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.810837 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.811144 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.811282 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.811444 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.811750 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.811856 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.812695 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.812932 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.813235 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.813597 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.813705 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.813884 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.814076 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.814177 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.814478 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.814582 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.814783 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.815003 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.815106 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.815436 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.815738 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.816042 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.816367 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.816755 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.817036 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.817353 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.817677 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.817988 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.818309 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.818426 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.818615 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.818731 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.818935 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.819038 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.819255 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.819389 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.819570 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.819678 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.821137 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.821259 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.821361 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.821770 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.821869 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.821964 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.822047 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.822262 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.822353 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.822434 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.822514 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.822606 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.822689 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.822769 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.822848 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.822928 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.823006 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.823075 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.823148 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.823238 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.823320 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.823399 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.823487 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.823569 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.823649 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.823737 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.823819 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.824017 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.824124 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.824510 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.824617 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.824714 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.824798 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.825004 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.825211 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.825310 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.825380 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.826045 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.826148 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.826231 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.826301 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.826301 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.826654 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.826748 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.826818 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.826903 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.826986 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.827138 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.827228 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.827456 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.827543 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.827814 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.828016 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.828304 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.828409 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.828532 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.828635 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.828912 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.829220 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.829365 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.829510 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.829626 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.829782 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.829900 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.830135 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.830263 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.830474 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.830590 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.830790 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.830907 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.831104 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.831228 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.831416 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.831531 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.831718 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.831832 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.831962 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 13:29:28.832083 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.832402 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.832718 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.833035 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.833353 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.833669 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.834212 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.834357 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.834610 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.834925 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.835240 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.835556 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.835869 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.836210 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.836528 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.836882 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.837208 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.837529 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.837849 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.838175 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.838493 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.838804 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.839119 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.839434 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.839750 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.840083 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.840428 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.840738 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.841175 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.841494 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.841818 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.842144 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.842484 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.842783 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.843108 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.843579 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.843954 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.844313 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.844656 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.844997 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.845330 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.845662 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.845973 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.846283 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.846592 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.846909 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.847227 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.847540 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.847855 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.848163 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.848602 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.848819 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.849129 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.849514 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.849744 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.850056 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.850441 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.850672 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.850978 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.851287 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.851593 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.851954 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.852239 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.852607 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.852860 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.853166 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.853477 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.853783 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.854118 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.854459 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.854780 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.855109 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.855424 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.855752 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.856066 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.856415 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.856746 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.857074 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.857383 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.857720 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.858037 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.858349 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.858747 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.859634 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.859923 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.860269 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.860608 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.860937 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.861249 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.861584 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.861907 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.862233 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.862554 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.862877 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.863211 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.863526 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.863844 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.864159 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.864498 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.864815 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.865136 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.865451 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.865764 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.866083 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.866404 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.866734 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.867063 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.867379 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.867715 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.868045 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.868424 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.868742 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.869093 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.869423 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.869738 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.870052 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.870360 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:29:28.870679 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 13:29:28.987425 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO dbcounter [None req-1e2aea8d-fe3b-4973-af9a-0156e422e9a2 None None] Registered counter for database nova_api Aug 24 13:29:29.010373 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG oslo_db.sqlalchemy.engines [None req-1e2aea8d-fe3b-4973-af9a-0156e422e9a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106200) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 13:29:29.017561 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG dbcounter [-] [106200] Writer thread running {{(pid=106200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 13:29:29.026528 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO dbcounter [None req-7f1f860e-dc58-4ccd-8000-e62fe00cdeb0 None None] Registered counter for database nova_api Aug 24 13:29:29.048077 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_db.sqlalchemy.engines [None req-7f1f860e-dc58-4ccd-8000-e62fe00cdeb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106201) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 13:29:29.055212 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG dbcounter [-] [106201] Writer thread running {{(pid=106201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 13:29:29.076059 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.context [None req-1e2aea8d-fe3b-4973-af9a-0156e422e9a2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),61617dbb-81a0-4cba-8ce2-26c27e8678f7(cell1) {{(pid=106200) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 13:29:29.080020 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG oslo_concurrency.lockutils [None req-1e2aea8d-fe3b-4973-af9a-0156e422e9a2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:29.080538 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG oslo_concurrency.lockutils [None req-1e2aea8d-fe3b-4973-af9a-0156e422e9a2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:29.082137 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG oslo_concurrency.lockutils [None req-1e2aea8d-fe3b-4973-af9a-0156e422e9a2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:29.082931 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG oslo_concurrency.lockutils [None req-1e2aea8d-fe3b-4973-af9a-0156e422e9a2 None None] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:29.083401 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG oslo_concurrency.lockutils [None req-1e2aea8d-fe3b-4973-af9a-0156e422e9a2 None None] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:29.085535 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG oslo_concurrency.lockutils [None req-1e2aea8d-fe3b-4973-af9a-0156e422e9a2 None None] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:29.087600 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO dbcounter [None req-1e2aea8d-fe3b-4973-af9a-0156e422e9a2 None None] Registered counter for database nova_cell0 Aug 24 13:29:29.094022 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO dbcounter [None req-1e2aea8d-fe3b-4973-af9a-0156e422e9a2 None None] Registered counter for database nova_cell1 Aug 24 13:29:29.101333 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG oslo_db.sqlalchemy.engines [None req-1e2aea8d-fe3b-4973-af9a-0156e422e9a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106200) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 13:29:29.103610 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG oslo_db.sqlalchemy.engines [None req-1e2aea8d-fe3b-4973-af9a-0156e422e9a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106200) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 13:29:29.108710 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG dbcounter [-] [106200] Writer thread running {{(pid=106200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 13:29:29.114595 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG dbcounter [-] [106200] Writer thread running {{(pid=106200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 13:29:29.115213 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.context [None req-7f1f860e-dc58-4ccd-8000-e62fe00cdeb0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),61617dbb-81a0-4cba-8ce2-26c27e8678f7(cell1) {{(pid=106201) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 13:29:29.119100 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-7f1f860e-dc58-4ccd-8000-e62fe00cdeb0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:29.119574 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-7f1f860e-dc58-4ccd-8000-e62fe00cdeb0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:29.121191 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-7f1f860e-dc58-4ccd-8000-e62fe00cdeb0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:29.121926 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-7f1f860e-dc58-4ccd-8000-e62fe00cdeb0 None None] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:29:29.122376 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-7f1f860e-dc58-4ccd-8000-e62fe00cdeb0 None None] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:29:29.124393 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-7f1f860e-dc58-4ccd-8000-e62fe00cdeb0 None None] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:29:29.126711 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO dbcounter [None req-7f1f860e-dc58-4ccd-8000-e62fe00cdeb0 None None] Registered counter for database nova_cell0 Aug 24 13:29:29.132338 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO dbcounter [None req-7f1f860e-dc58-4ccd-8000-e62fe00cdeb0 None None] Registered counter for database nova_cell1 Aug 24 13:29:29.139709 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_db.sqlalchemy.engines [None req-7f1f860e-dc58-4ccd-8000-e62fe00cdeb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106201) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 13:29:29.141067 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_db.sqlalchemy.engines [None req-7f1f860e-dc58-4ccd-8000-e62fe00cdeb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106201) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 13:29:29.148672 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG dbcounter [-] [106201] Writer thread running {{(pid=106201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 13:29:29.149031 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG dbcounter [-] [106201] Writer thread running {{(pid=106201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 13:29:29.257882 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO dbcounter [None req-1e2aea8d-fe3b-4973-af9a-0156e422e9a2 None None] Registered counter for database nova_cell0 Aug 24 13:29:29.267214 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG oslo_db.sqlalchemy.engines [None req-1e2aea8d-fe3b-4973-af9a-0156e422e9a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106200) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 13:29:29.271843 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG dbcounter [-] [106200] Writer thread running {{(pid=106200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 13:29:29.295362 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO dbcounter [None req-7f1f860e-dc58-4ccd-8000-e62fe00cdeb0 None None] Registered counter for database nova_cell0 Aug 24 13:29:29.305201 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_db.sqlalchemy.engines [None req-7f1f860e-dc58-4ccd-8000-e62fe00cdeb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106201) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 13:29:29.309652 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG dbcounter [-] [106201] Writer thread running {{(pid=106201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 13:29:29.650829 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: WARNING keystonemiddleware.auth_token [None req-1e2aea8d-fe3b-4973-af9a-0156e422e9a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 13:29:29.657723 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: WARNING keystonemiddleware.auth_token [None req-7f1f860e-dc58-4ccd-8000-e62fe00cdeb0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 13:29:29.658298 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: WARNING keystonemiddleware.auth_token [None req-1e2aea8d-fe3b-4973-af9a-0156e422e9a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 13:29:29.665212 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: WARNING keystonemiddleware.auth_token [None req-7f1f860e-dc58-4ccd-8000-e62fe00cdeb0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 13:29:30.005740 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: WARNING keystonemiddleware.auth_token [None req-1e2aea8d-fe3b-4973-af9a-0156e422e9a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 13:29:30.006438 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: WARNING keystonemiddleware.auth_token [None req-7f1f860e-dc58-4ccd-8000-e62fe00cdeb0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 13:29:30.011691 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: WARNING keystonemiddleware.auth_token [None req-1e2aea8d-fe3b-4973-af9a-0156e422e9a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 13:29:30.012404 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: WARNING keystonemiddleware.auth_token [None req-7f1f860e-dc58-4ccd-8000-e62fe00cdeb0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 13:29:30.017143 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ce47d5a9c0 pid: 106200 (default app) Aug 24 13:29:30.017790 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ce47d5a9c0 pid: 106201 (default app) Aug 24 13:29:30.019407 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-1e2aea8d-fe3b-4973-af9a-0156e422e9a2 None None] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:29:30.020690 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-1e2aea8d-fe3b-4973-af9a-0156e422e9a2 None None] 10.222.0.73 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001943 Aug 24 13:29:30.021126 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 1/1] 10.222.0.73 () {50 vars in 788 bytes} [Wed Aug 24 13:29:30 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:30:56.823484 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-7f1f860e-dc58-4ccd-8000-e62fe00cdeb0 None None] Calling method '>' {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:30:56.824681 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-7f1f860e-dc58-4ccd-8000-e62fe00cdeb0 None None] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002029 Aug 24 13:30:56.825097 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 1/2] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 13:30:56 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:30:56.839151 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG dbcounter [-] [106200] Writing DB stats nova_api:SELECT=3 {{(pid=106200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:30:56.840479 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG dbcounter [-] [106200] Writing DB stats nova_cell0:SELECT=3 {{(pid=106200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:30:56.841520 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG dbcounter [-] [106200] Writing DB stats nova_cell1:SELECT=3 {{(pid=106200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:30:56.842356 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG dbcounter [-] [106200] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:30:57.726486 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-f4411dc7-12c4-476f-9e10-80b63eb3b574 admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:30:57.764212 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-f4411dc7-12c4-476f-9e10-80b63eb3b574 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.931648 Aug 24 13:30:57.765078 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 2/3] 10.222.0.73 () {60 vars in 1292 bytes} [Wed Aug 24 13:30:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:31:00.184665 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-7f1f860e-dc58-4ccd-8000-e62fe00cdeb0 None None] Calling method '>' {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:00.185728 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-7f1f860e-dc58-4ccd-8000-e62fe00cdeb0 None None] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Aug 24 13:31:00.186337 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 2/4] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 13:31:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:31:00.657067 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-035cf04e-5723-4829-bf53-71e088464bdc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 256, "id": "c1", "rxtx_factor": 1.0, "disk": 1, "name": "cirros256", "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:31:00.677843 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 13:31:00.677843 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: warnings.warn(msg) Aug 24 13:31:00.785808 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-035cf04e-5723-4829-bf53-71e088464bdc admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.593043 Aug 24 13:31:00.786453 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 3/5] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 13:31:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 13:31:01.042510 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-42873d92-3d68-4ed5-a2a4-2c48c4f61169 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:31:01.047958 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 13:31:01.047958 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: warnings.warn(msg) Aug 24 13:31:01.051085 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG dbcounter [-] [106201] Writing DB stats nova_api:SELECT=3 {{(pid=106201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:31:01.052031 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG dbcounter [-] [106201] Writing DB stats nova_cell1:SELECT=3 {{(pid=106201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:31:01.053125 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG dbcounter [-] [106201] Writing DB stats nova_cell0:SELECT=3 {{(pid=106201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:31:01.054249 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG dbcounter [-] [106201] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:31:01.217602 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-42873d92-3d68-4ed5-a2a4-2c48c4f61169 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.421406 Aug 24 13:31:01.218442 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 3/6] 10.222.0.73 () {64 vars in 1336 bytes} [Wed Aug 24 13:31:00 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:31:03.625253 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-035cf04e-5723-4829-bf53-71e088464bdc admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:03.626274 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-035cf04e-5723-4829-bf53-71e088464bdc admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Aug 24 13:31:03.628066 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 4/7] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 13:31:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:31:04.348974 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-3c63cfd7-c5f0-4ba8-81a2-8374aa88e160 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d1", "vcpus": 1, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "disk": 5}} {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:31:04.367771 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 13:31:04.367771 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: warnings.warn(msg) Aug 24 13:31:04.453554 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-3c63cfd7-c5f0-4ba8-81a2-8374aa88e160 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.819611 Aug 24 13:31:04.454458 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 4/8] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 13:31:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 13:31:04.467667 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-770fd1d4-fc13-46b9-a660-b30535252d74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:31:04.470520 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 13:31:04.470520 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: warnings.warn(msg) Aug 24 13:31:04.617814 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-770fd1d4-fc13-46b9-a660-b30535252d74 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.154810 Aug 24 13:31:04.618649 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 5/9] 10.222.0.73 () {64 vars in 1336 bytes} [Wed Aug 24 13:31:04 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:31:07.058329 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-3c63cfd7-c5f0-4ba8-81a2-8374aa88e160 admin admin] Calling method '>' {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:07.059574 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-3c63cfd7-c5f0-4ba8-81a2-8374aa88e160 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001797 Aug 24 13:31:07.060531 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 5/10] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 13:31:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:31:07.492088 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-0430e257-002f-4fec-8b3d-43ee1adde79e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 1024, "name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0}} {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:31:07.601804 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-0430e257-002f-4fec-8b3d-43ee1adde79e admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.535079 Aug 24 13:31:07.602361 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 6/11] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 13:31:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 13:31:07.615043 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-428ca38c-206a-4aed-9cd6-87710f98b576 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:31:07.720544 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-428ca38c-206a-4aed-9cd6-87710f98b576 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109251 Aug 24 13:31:07.721159 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 6/12] 10.222.0.73 () {64 vars in 1336 bytes} [Wed Aug 24 13:31:07 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:31:10.122363 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-0430e257-002f-4fec-8b3d-43ee1adde79e admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:10.123300 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-0430e257-002f-4fec-8b3d-43ee1adde79e admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 24 13:31:10.123708 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 7/13] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 13:31:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:31:10.578164 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-fefcc600-c368-4ba7-8847-afa71c974c8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 2048, "id": "d3", "rxtx_factor": 1.0}} {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:31:10.659840 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-fefcc600-c368-4ba7-8847-afa71c974c8d admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.529418 Aug 24 13:31:10.660522 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 7/14] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 13:31:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 13:31:10.673523 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-04161c50-8e13-45d3-af09-f5a942156163 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:31:10.755817 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-04161c50-8e13-45d3-af09-f5a942156163 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086294 Aug 24 13:31:10.756577 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 8/15] 10.222.0.73 () {64 vars in 1336 bytes} [Wed Aug 24 13:31:10 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:31:13.258590 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-fefcc600-c368-4ba7-8847-afa71c974c8d admin admin] Calling method '>' {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:13.259605 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-fefcc600-c368-4ba7-8847-afa71c974c8d admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 24 13:31:13.260013 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 8/16] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 13:31:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:31:13.747996 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-6f485dba-d232-486d-8801-baab6c189dab admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d4", "disk": 20, "rxtx_factor": 1.0, "name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:31:13.818912 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-6f485dba-d232-486d-8801-baab6c189dab admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.551183 Aug 24 13:31:13.827692 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 9/17] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 13:31:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 13:31:13.837144 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-f25c9d3b-1495-4f0b-8820-5ae1d1cc1112 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:31:13.926629 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-f25c9d3b-1495-4f0b-8820-5ae1d1cc1112 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098036 Aug 24 13:31:13.927216 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 9/18] 10.222.0.73 () {64 vars in 1336 bytes} [Wed Aug 24 13:31:13 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:31:16.572786 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-6f485dba-d232-486d-8801-baab6c189dab admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:16.574224 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-6f485dba-d232-486d-8801-baab6c189dab admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002090 Aug 24 13:31:16.575457 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 10/19] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 13:31:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:31:17.076334 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-aa0826b2-883c-449d-a668-8620bb5f3c77 admin admin] Calling method '>' {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:17.103256 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-aa0826b2-883c-449d-a668-8620bb5f3c77 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.519482 Aug 24 13:31:17.103828 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 10/20] 10.222.0.73 () {60 vars in 1292 bytes} [Wed Aug 24 13:31:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:31:19.718567 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-6f485dba-d232-486d-8801-baab6c189dab admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:19.720390 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-6f485dba-d232-486d-8801-baab6c189dab admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002070 Aug 24 13:31:19.721154 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 11/21] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 13:31:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:31:20.217985 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-fe2acf38-9a0b-4458-af27-a9fa2fe80fc2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:31:20.299385 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-fe2acf38-9a0b-4458-af27-a9fa2fe80fc2 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.568586 Aug 24 13:31:20.299926 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 11/22] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 13:31:19 2022] POST /compute/v2.1/flavors => generated 402 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 13:31:20.313973 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-d6ca04e0-f9fa-4371-9fe1-32b12dfd6d48 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:31:20.417094 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-d6ca04e0-f9fa-4371-9fe1-32b12dfd6d48 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106848 Aug 24 13:31:20.417725 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 12/23] 10.222.0.73 () {64 vars in 1333 bytes} [Wed Aug 24 13:31:20 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:31:22.851087 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-fe2acf38-9a0b-4458-af27-a9fa2fe80fc2 admin admin] Calling method '>' {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:22.852093 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-fe2acf38-9a0b-4458-af27-a9fa2fe80fc2 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 24 13:31:22.852548 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 12/24] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 13:31:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:31:23.244624 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-a4c72b5b-c73e-4f4a-a82b-c4bf834976c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 1, "id": "2", "swap": 0, "disk": 20}} {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:31:23.319776 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-a4c72b5b-c73e-4f4a-a82b-c4bf834976c3 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.460605 Aug 24 13:31:23.320511 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 13/25] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 13:31:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 13:31:23.333415 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-858ec460-2384-4753-8598-1a8ac0ff61e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:31:23.399564 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-858ec460-2384-4753-8598-1a8ac0ff61e8 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069909 Aug 24 13:31:23.400151 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 13/26] 10.222.0.73 () {64 vars in 1333 bytes} [Wed Aug 24 13:31:23 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:31:25.861413 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-a4c72b5b-c73e-4f4a-a82b-c4bf834976c3 admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:25.861932 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-a4c72b5b-c73e-4f4a-a82b-c4bf834976c3 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 24 13:31:25.863112 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 14/27] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 13:31:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:31:26.345631 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-b4aec9e3-7272-4bcf-ae59-39648b1faa0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "os-flavor-access:is_public": true, "vcpus": 2, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "3", "swap": 0, "ram": 4096}} {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:31:26.427287 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-b4aec9e3-7272-4bcf-ae59-39648b1faa0e admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.558054 Aug 24 13:31:26.427894 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 14/28] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 13:31:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 13:31:26.441343 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-2cbc7327-7351-4568-96b9-9729b9fede11 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:31:26.542571 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-2cbc7327-7351-4568-96b9-9729b9fede11 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105229 Aug 24 13:31:26.556212 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 15/29] 10.222.0.73 () {64 vars in 1333 bytes} [Wed Aug 24 13:31:26 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:31:29.002582 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-b4aec9e3-7272-4bcf-ae59-39648b1faa0e admin admin] Calling method '>' {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:29.003594 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-b4aec9e3-7272-4bcf-ae59-39648b1faa0e admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 24 13:31:29.004449 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 15/30] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 13:31:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:31:29.483052 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-f43a79e7-c187-4f47-b1f2-8bef0554eb71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "disk": 80, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "swap": 0}} {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:31:29.488961 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG dbcounter [-] [106200] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:31:29.567984 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-f43a79e7-c187-4f47-b1f2-8bef0554eb71 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.557168 Aug 24 13:31:29.568913 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 16/31] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 13:31:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 13:31:29.581177 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-83053d5d-95f8-4108-a605-bb510a1fba8d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:31:29.667147 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-83053d5d-95f8-4108-a605-bb510a1fba8d admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089774 Aug 24 13:31:29.670642 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 16/32] 10.222.0.73 () {64 vars in 1333 bytes} [Wed Aug 24 13:31:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:31:32.166213 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-f43a79e7-c187-4f47-b1f2-8bef0554eb71 admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:32.167224 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-f43a79e7-c187-4f47-b1f2-8bef0554eb71 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 24 13:31:32.168634 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 17/33] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 13:31:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:31:32.689833 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-6551c64d-cd42-4757-9b18-c62e3d36ad7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 160, "os-flavor-access:is_public": true, "id": "5", "rxtx_factor": 1.0, "ram": 16384}} {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:31:32.788705 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-6551c64d-cd42-4757-9b18-c62e3d36ad7f admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.613526 Aug 24 13:31:32.789669 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 17/34] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 13:31:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 13:31:32.803435 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-d31b8405-3cdd-4cb5-9a43-ec9e3feb8a2c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:31:32.896434 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-d31b8405-3cdd-4cb5-9a43-ec9e3feb8a2c admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097825 Aug 24 13:31:32.897213 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 18/35] 10.222.0.73 () {64 vars in 1333 bytes} [Wed Aug 24 13:31:32 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:31:53.452922 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-6551c64d-cd42-4757-9b18-c62e3d36ad7f admin admin] Calling method '>' {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:53.462119 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-6551c64d-cd42-4757-9b18-c62e3d36ad7f admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.009736 Aug 24 13:31:53.462539 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 18/36] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 13:31:53 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:31:53.880457 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-57a85d76-7e90-4aa6-bfc7-5b37659f1444 admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:53.899014 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-57a85d76-7e90-4aa6-bfc7-5b37659f1444 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.429749 Aug 24 13:31:53.899616 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 19/37] 10.222.0.73 () {60 vars in 1292 bytes} [Wed Aug 24 13:31:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:31:55.019754 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-6551c64d-cd42-4757-9b18-c62e3d36ad7f admin admin] Calling method '>' {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:55.020774 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-6551c64d-cd42-4757-9b18-c62e3d36ad7f admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 Aug 24 13:31:55.021147 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 19/38] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 13:31:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:31:55.568957 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-414a6d9b-738b-4125-b995-ab477bb53616 admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:55.575658 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.wsgi [None req-414a6d9b-738b-4125-b995-ab477bb53616 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 13:31:55.579030 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-414a6d9b-738b-4125-b995-ab477bb53616 admin admin] Request method failure captured: Aug 24 13:31:55.579030 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 13:31:55.579030 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: Accept: application/json Aug 24 13:31:55.579030 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: Accept-Encoding: gzip, deflate Aug 24 13:31:55.579030 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: Connection: keep-alive Aug 24 13:31:55.579030 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: Content-Length: 0 Aug 24 13:31:55.579030 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: Host: 10.222.0.73 Aug 24 13:31:55.579030 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: Openstack-Api-Version: compute 2.90 Aug 24 13:31:55.579030 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: Openstack-System-Scope: None Aug 24 13:31:55.579030 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: User-Agent: python-novaclient Aug 24 13:31:55.579030 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Auth-Token: gAAAAABjBihK9aILoZI6DP9cowhOuqDhtHuMdI9ZCxh5P4nOvwolp5SfQ2iSS2toMejUQT0WAFG4C5CkpDF9RUKs0mBWnUhLBoUKg7v9IPSy4CGeAxdFfv58ONhKd7Xpm7tRfpg76Y6YmBRXXMZgPxjyEo0JUH3JjU821hUDtaxbz7jaDXDvglw Aug 24 13:31:55.579030 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Domain-Id: None Aug 24 13:31:55.579030 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Domain-Name: None Aug 24 13:31:55.579030 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Identity-Status: Confirmed Aug 24 13:31:55.579030 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Is-Admin-Project: True Aug 24 13:31:55.579030 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 13:31:55.579030 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Project-Domain-Id: default Aug 24 13:31:55.579030 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Project-Domain-Name: Default Aug 24 13:31:55.579030 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Project-Id: 1e28975466b54f229ea6496a2befdfd6 Aug 24 13:31:55.579030 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Project-Name: admin Aug 24 13:31:55.579030 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Role: member,reader,admin Aug 24 13:31:55.579030 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Roles: member,reader,admin Aug 24 13:31:55.580744 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1e28975466b54f229ea6496a2befdfd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1e28975466b54f229ea6496a2befdfd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1e28975466b54f229ea6496a2befdfd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1e28975466b54f229ea6496a2befdfd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:31:55.580744 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Tenant: admin Aug 24 13:31:55.580744 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Tenant-Id: 1e28975466b54f229ea6496a2befdfd6 Aug 24 13:31:55.580744 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Tenant-Name: admin Aug 24 13:31:55.580744 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-User: admin Aug 24 13:31:55.580744 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-User-Domain-Id: default Aug 24 13:31:55.580744 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-User-Domain-Name: Default Aug 24 13:31:55.580744 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-User-Id: 23e13f53885b4bcd974e51d34ba1099e Aug 24 13:31:55.580744 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-User-Name: admin Aug 24 13:31:55.580744 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: method: > Aug 24 13:31:55.580744 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: exception: Flavor 42 could not be found. Aug 24 13:31:55.580744 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: action_args: {'id': '42'} Aug 24 13:31:55.580744 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:31:55.580744 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:31:55.581753 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 13:31:55.581753 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 13:31:55.581753 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 13:31:55.581753 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 13:31:55.581753 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 13:31:55.581753 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 13:31:55.581753 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 13:31:55.581753 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 13:31:55.581753 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 13:31:55.581753 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:31:55.581753 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 13:31:55.581753 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 13:31:55.581753 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 13:31:55.581753 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi Aug 24 13:31:55.581753 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:31:55.581753 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi Aug 24 13:31:55.581753 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:31:55.581753 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:31:55.581753 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:31:55.582947 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:31:55.582947 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:31:55.582947 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:31:55.582947 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:31:55.582947 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 13:31:55.582947 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:31:55.582947 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 13:31:55.582947 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi Aug 24 13:31:55.582947 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:31:55.582947 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi Aug 24 13:31:55.582947 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:31:55.582947 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:31:55.582947 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:31:55.582947 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:31:55.582947 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:31:55.582947 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 13:31:55.582947 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi Aug 24 13:31:55.582947 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-414a6d9b-738b-4125-b995-ab477bb53616 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:31:55.584150 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-414a6d9b-738b-4125-b995-ab477bb53616 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.421823 Aug 24 13:31:55.584150 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 20/39] 10.222.0.73 () {60 vars in 1190 bytes} [Wed Aug 24 13:31:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 424 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 13:31:55.597894 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-294bf703-6cdb-46d7-bcca-0c40b0651b6a admin admin] Calling method '>' {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:55.602094 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG dbcounter [-] [106201] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:31:55.621483 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-294bf703-6cdb-46d7-bcca-0c40b0651b6a admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029227 Aug 24 13:31:55.622063 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 20/40] 10.222.0.73 () {60 vars in 1210 bytes} [Wed Aug 24 13:31:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:31:55.631922 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-829e5261-0fdd-469b-99ff-9988c0ac19e1 admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:55.656737 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-829e5261-0fdd-469b-99ff-9988c0ac19e1 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028222 Aug 24 13:31:55.657300 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 21/41] 10.222.0.73 () {60 vars in 1210 bytes} [Wed Aug 24 13:31:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:31:55.667384 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-3a984e93-c36d-4a23-91b2-5f2a17c64174 admin admin] Calling method '>' {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:55.673649 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.wsgi [None req-3a984e93-c36d-4a23-91b2-5f2a17c64174 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 13:31:55.676929 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-3a984e93-c36d-4a23-91b2-5f2a17c64174 admin admin] Request method failure captured: Aug 24 13:31:55.676929 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 13:31:55.676929 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: Accept: application/json Aug 24 13:31:55.676929 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: Accept-Encoding: gzip, deflate Aug 24 13:31:55.676929 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: Connection: keep-alive Aug 24 13:31:55.676929 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: Content-Length: 0 Aug 24 13:31:55.676929 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: Host: 10.222.0.73 Aug 24 13:31:55.676929 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: Openstack-Api-Version: compute 2.90 Aug 24 13:31:55.676929 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: Openstack-System-Scope: None Aug 24 13:31:55.676929 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: User-Agent: python-novaclient Aug 24 13:31:55.676929 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Auth-Token: gAAAAABjBihK9aILoZI6DP9cowhOuqDhtHuMdI9ZCxh5P4nOvwolp5SfQ2iSS2toMejUQT0WAFG4C5CkpDF9RUKs0mBWnUhLBoUKg7v9IPSy4CGeAxdFfv58ONhKd7Xpm7tRfpg76Y6YmBRXXMZgPxjyEo0JUH3JjU821hUDtaxbz7jaDXDvglw Aug 24 13:31:55.676929 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Domain-Id: None Aug 24 13:31:55.676929 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Domain-Name: None Aug 24 13:31:55.676929 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Identity-Status: Confirmed Aug 24 13:31:55.676929 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Is-Admin-Project: True Aug 24 13:31:55.676929 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 13:31:55.676929 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Project-Domain-Id: default Aug 24 13:31:55.676929 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Project-Domain-Name: Default Aug 24 13:31:55.676929 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Project-Id: 1e28975466b54f229ea6496a2befdfd6 Aug 24 13:31:55.676929 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Project-Name: admin Aug 24 13:31:55.676929 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Role: member,reader,admin Aug 24 13:31:55.676929 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Roles: member,reader,admin Aug 24 13:31:55.678526 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1e28975466b54f229ea6496a2befdfd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1e28975466b54f229ea6496a2befdfd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1e28975466b54f229ea6496a2befdfd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1e28975466b54f229ea6496a2befdfd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:31:55.678526 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Tenant: admin Aug 24 13:31:55.678526 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Tenant-Id: 1e28975466b54f229ea6496a2befdfd6 Aug 24 13:31:55.678526 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Tenant-Name: admin Aug 24 13:31:55.678526 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-User: admin Aug 24 13:31:55.678526 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-User-Domain-Id: default Aug 24 13:31:55.678526 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-User-Domain-Name: Default Aug 24 13:31:55.678526 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-User-Id: 23e13f53885b4bcd974e51d34ba1099e Aug 24 13:31:55.678526 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-User-Name: admin Aug 24 13:31:55.678526 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: method: > Aug 24 13:31:55.678526 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: exception: Flavor 42 could not be found. Aug 24 13:31:55.678526 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: action_args: {'id': '42'} Aug 24 13:31:55.678526 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:31:55.678526 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:31:55.679610 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 13:31:55.679610 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 13:31:55.679610 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 13:31:55.679610 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 13:31:55.679610 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 13:31:55.679610 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 13:31:55.679610 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 13:31:55.679610 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 13:31:55.679610 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 13:31:55.679610 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:31:55.679610 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 13:31:55.679610 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 13:31:55.679610 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 13:31:55.679610 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi Aug 24 13:31:55.679610 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:31:55.679610 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi Aug 24 13:31:55.679610 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:31:55.679610 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:31:55.679610 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:31:55.687426 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:31:55.687426 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:31:55.687426 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:31:55.687426 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:31:55.687426 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 13:31:55.687426 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:31:55.687426 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 13:31:55.687426 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi Aug 24 13:31:55.687426 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:31:55.687426 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi Aug 24 13:31:55.687426 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:31:55.687426 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:31:55.687426 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:31:55.687426 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:31:55.687426 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:31:55.687426 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 13:31:55.687426 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi Aug 24 13:31:55.687426 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-3a984e93-c36d-4a23-91b2-5f2a17c64174 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:31:55.688646 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-3a984e93-c36d-4a23-91b2-5f2a17c64174 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015077 Aug 24 13:31:55.688646 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 21/42] 10.222.0.73 () {60 vars in 1190 bytes} [Wed Aug 24 13:31:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 13:31:56.660378 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-829e5261-0fdd-469b-99ff-9988c0ac19e1 admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:56.661396 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-829e5261-0fdd-469b-99ff-9988c0ac19e1 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 24 13:31:56.661800 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 22/43] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 13:31:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:31:57.195313 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-2ab467f5-5842-40ce-b5d7-e456496f8588 admin admin] Calling method '>' {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:57.204417 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.wsgi [None req-2ab467f5-5842-40ce-b5d7-e456496f8588 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 13:31:57.206368 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-2ab467f5-5842-40ce-b5d7-e456496f8588 admin admin] Request method failure captured: Aug 24 13:31:57.206368 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 13:31:57.206368 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: Accept: application/json Aug 24 13:31:57.206368 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: Accept-Encoding: gzip, deflate Aug 24 13:31:57.206368 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: Connection: keep-alive Aug 24 13:31:57.206368 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: Content-Length: 0 Aug 24 13:31:57.206368 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: Host: 10.222.0.73 Aug 24 13:31:57.206368 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: Openstack-Api-Version: compute 2.90 Aug 24 13:31:57.206368 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: Openstack-System-Scope: None Aug 24 13:31:57.206368 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: User-Agent: python-novaclient Aug 24 13:31:57.206368 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Auth-Token: gAAAAABjBihMYQaVMT7AaEthKGPEv9XtauPmvyFFcYQLCIkqlYBjTbz7H9hgik92RvT05aCr2jhUG8B2x7beNaI10qLBjRN0RO91kSah5AikvavpmbI45CJj9tVoJ-p88ciyP7kdO_xwdmG_vtlg5cHMkhXJB1iHPx6qYJuCr6uhO_ymzhZs6-4 Aug 24 13:31:57.206368 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Domain-Id: None Aug 24 13:31:57.206368 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Domain-Name: None Aug 24 13:31:57.206368 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Identity-Status: Confirmed Aug 24 13:31:57.206368 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Is-Admin-Project: True Aug 24 13:31:57.206368 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 13:31:57.206368 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Project-Domain-Id: default Aug 24 13:31:57.206368 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Project-Domain-Name: Default Aug 24 13:31:57.206368 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Project-Id: 1e28975466b54f229ea6496a2befdfd6 Aug 24 13:31:57.206368 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Project-Name: admin Aug 24 13:31:57.206368 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Role: member,reader,admin Aug 24 13:31:57.206368 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Roles: member,reader,admin Aug 24 13:31:57.207707 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1e28975466b54f229ea6496a2befdfd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1e28975466b54f229ea6496a2befdfd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1e28975466b54f229ea6496a2befdfd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1e28975466b54f229ea6496a2befdfd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:31:57.207707 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Tenant: admin Aug 24 13:31:57.207707 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Tenant-Id: 1e28975466b54f229ea6496a2befdfd6 Aug 24 13:31:57.207707 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Tenant-Name: admin Aug 24 13:31:57.207707 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-User: admin Aug 24 13:31:57.207707 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-User-Domain-Id: default Aug 24 13:31:57.207707 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-User-Domain-Name: Default Aug 24 13:31:57.207707 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-User-Id: 23e13f53885b4bcd974e51d34ba1099e Aug 24 13:31:57.207707 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-User-Name: admin Aug 24 13:31:57.207707 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: method: > Aug 24 13:31:57.207707 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: exception: Flavor 84 could not be found. Aug 24 13:31:57.207707 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: action_args: {'id': '84'} Aug 24 13:31:57.207707 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:31:57.207707 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:31:57.208718 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 13:31:57.208718 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 13:31:57.208718 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 13:31:57.208718 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 13:31:57.208718 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 13:31:57.208718 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 13:31:57.208718 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 13:31:57.208718 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 13:31:57.208718 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 13:31:57.208718 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:31:57.208718 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 13:31:57.208718 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 13:31:57.208718 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 13:31:57.208718 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi Aug 24 13:31:57.208718 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:31:57.208718 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi Aug 24 13:31:57.208718 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:31:57.208718 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:31:57.208718 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:31:57.210084 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:31:57.210084 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:31:57.210084 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:31:57.210084 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:31:57.210084 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 13:31:57.210084 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:31:57.210084 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 13:31:57.210084 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi Aug 24 13:31:57.210084 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:31:57.210084 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi Aug 24 13:31:57.210084 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:31:57.210084 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:31:57.210084 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:31:57.210084 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:31:57.210084 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:31:57.210084 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 13:31:57.210084 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi Aug 24 13:31:57.210084 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-2ab467f5-5842-40ce-b5d7-e456496f8588 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:31:57.211438 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-2ab467f5-5842-40ce-b5d7-e456496f8588 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.406868 Aug 24 13:31:57.211438 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 22/44] 10.222.0.73 () {60 vars in 1190 bytes} [Wed Aug 24 13:31:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 408 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 13:31:57.219639 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-591ec079-17fa-4a9b-8089-dcccd09a9271 admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:57.234972 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-591ec079-17fa-4a9b-8089-dcccd09a9271 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020265 Aug 24 13:31:57.235544 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 23/45] 10.222.0.73 () {60 vars in 1210 bytes} [Wed Aug 24 13:31:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:31:57.245423 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-68c7ac00-7a61-45f7-b7d5-05c077a5cdd9 admin admin] Calling method '>' {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:57.260766 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-68c7ac00-7a61-45f7-b7d5-05c077a5cdd9 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018550 Aug 24 13:31:57.261411 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 23/46] 10.222.0.73 () {60 vars in 1210 bytes} [Wed Aug 24 13:31:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:31:57.270744 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-df1dd6b6-cff8-4e7b-8578-ad8bc8369358 admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:57.276972 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.wsgi [None req-df1dd6b6-cff8-4e7b-8578-ad8bc8369358 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 13:31:57.278502 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-df1dd6b6-cff8-4e7b-8578-ad8bc8369358 admin admin] Request method failure captured: Aug 24 13:31:57.278502 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 13:31:57.278502 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: Accept: application/json Aug 24 13:31:57.278502 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: Accept-Encoding: gzip, deflate Aug 24 13:31:57.278502 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: Connection: keep-alive Aug 24 13:31:57.278502 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: Content-Length: 0 Aug 24 13:31:57.278502 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: Host: 10.222.0.73 Aug 24 13:31:57.278502 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: Openstack-Api-Version: compute 2.90 Aug 24 13:31:57.278502 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: Openstack-System-Scope: None Aug 24 13:31:57.278502 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: User-Agent: python-novaclient Aug 24 13:31:57.278502 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Auth-Token: gAAAAABjBihMYQaVMT7AaEthKGPEv9XtauPmvyFFcYQLCIkqlYBjTbz7H9hgik92RvT05aCr2jhUG8B2x7beNaI10qLBjRN0RO91kSah5AikvavpmbI45CJj9tVoJ-p88ciyP7kdO_xwdmG_vtlg5cHMkhXJB1iHPx6qYJuCr6uhO_ymzhZs6-4 Aug 24 13:31:57.278502 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Domain-Id: None Aug 24 13:31:57.278502 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Domain-Name: None Aug 24 13:31:57.278502 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Identity-Status: Confirmed Aug 24 13:31:57.278502 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Is-Admin-Project: True Aug 24 13:31:57.278502 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 13:31:57.278502 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Project-Domain-Id: default Aug 24 13:31:57.278502 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Project-Domain-Name: Default Aug 24 13:31:57.278502 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Project-Id: 1e28975466b54f229ea6496a2befdfd6 Aug 24 13:31:57.278502 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Project-Name: admin Aug 24 13:31:57.278502 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Role: member,reader,admin Aug 24 13:31:57.278502 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Roles: member,reader,admin Aug 24 13:31:57.279812 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1e28975466b54f229ea6496a2befdfd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1e28975466b54f229ea6496a2befdfd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1e28975466b54f229ea6496a2befdfd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1e28975466b54f229ea6496a2befdfd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:31:57.279812 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Tenant: admin Aug 24 13:31:57.279812 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Tenant-Id: 1e28975466b54f229ea6496a2befdfd6 Aug 24 13:31:57.279812 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Tenant-Name: admin Aug 24 13:31:57.279812 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-User: admin Aug 24 13:31:57.279812 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-User-Domain-Id: default Aug 24 13:31:57.279812 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-User-Domain-Name: Default Aug 24 13:31:57.279812 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-User-Id: 23e13f53885b4bcd974e51d34ba1099e Aug 24 13:31:57.279812 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-User-Name: admin Aug 24 13:31:57.279812 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: method: > Aug 24 13:31:57.279812 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: exception: Flavor 84 could not be found. Aug 24 13:31:57.279812 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: action_args: {'id': '84'} Aug 24 13:31:57.279812 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:31:57.279812 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:31:57.280640 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 13:31:57.280640 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 13:31:57.280640 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 13:31:57.280640 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 13:31:57.280640 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 13:31:57.280640 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 13:31:57.280640 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 13:31:57.280640 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 13:31:57.280640 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 13:31:57.280640 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:31:57.280640 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 13:31:57.280640 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 13:31:57.280640 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 13:31:57.280640 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi Aug 24 13:31:57.280640 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:31:57.280640 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi Aug 24 13:31:57.280640 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:31:57.280640 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:31:57.280640 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:31:57.281703 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:31:57.281703 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:31:57.281703 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:31:57.281703 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:31:57.281703 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 13:31:57.281703 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:31:57.281703 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 13:31:57.281703 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi Aug 24 13:31:57.281703 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:31:57.281703 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi Aug 24 13:31:57.281703 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:31:57.281703 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:31:57.281703 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:31:57.281703 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:31:57.281703 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:31:57.281703 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 13:31:57.281703 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi Aug 24 13:31:57.281703 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-df1dd6b6-cff8-4e7b-8578-ad8bc8369358 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:31:57.282801 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-df1dd6b6-cff8-4e7b-8578-ad8bc8369358 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012749 Aug 24 13:31:57.283688 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 24/47] 10.222.0.73 () {60 vars in 1190 bytes} [Wed Aug 24 13:31:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 13:31:58.427838 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-68c7ac00-7a61-45f7-b7d5-05c077a5cdd9 admin admin] Calling method '>' {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:58.428893 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-68c7ac00-7a61-45f7-b7d5-05c077a5cdd9 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 24 13:31:58.429300 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 24/48] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 13:31:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:31:58.991577 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-e2f79274-0b20-4eae-969b-46c5ed65c5ae admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:58.998161 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.wsgi [None req-e2f79274-0b20-4eae-969b-46c5ed65c5ae admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 13:31:58.999660 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-e2f79274-0b20-4eae-969b-46c5ed65c5ae admin admin] Request method failure captured: Aug 24 13:31:58.999660 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 13:31:58.999660 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: Accept: application/json Aug 24 13:31:58.999660 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: Accept-Encoding: gzip, deflate Aug 24 13:31:58.999660 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: Connection: keep-alive Aug 24 13:31:58.999660 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: Content-Length: 0 Aug 24 13:31:58.999660 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: Host: 10.222.0.73 Aug 24 13:31:58.999660 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: Openstack-Api-Version: compute 2.90 Aug 24 13:31:58.999660 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: Openstack-System-Scope: None Aug 24 13:31:58.999660 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: User-Agent: python-novaclient Aug 24 13:31:58.999660 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Auth-Token: gAAAAABjBihOsOj1k9zY2syjQbyOpqukJMBQvsatFCnM1-wPoZ563YHqsoTPNpuxx_wDhzk_ElXC1oQupWWAj49hgyHLi6tYXn07s259c0Dx_sMzsszoUofYDxX0ObkG-kMGQzjdFePBfbmcncgvVmpJRs9PJ7L2cxwnDq4hYL76KBUitCDyRZU Aug 24 13:31:58.999660 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Domain-Id: None Aug 24 13:31:58.999660 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Domain-Name: None Aug 24 13:31:58.999660 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Identity-Status: Confirmed Aug 24 13:31:58.999660 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Is-Admin-Project: True Aug 24 13:31:58.999660 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 13:31:58.999660 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Project-Domain-Id: default Aug 24 13:31:58.999660 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Project-Domain-Name: Default Aug 24 13:31:58.999660 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Project-Id: 1e28975466b54f229ea6496a2befdfd6 Aug 24 13:31:58.999660 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Project-Name: admin Aug 24 13:31:58.999660 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Role: member,reader,admin Aug 24 13:31:58.999660 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Roles: member,reader,admin Aug 24 13:31:59.001055 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1e28975466b54f229ea6496a2befdfd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1e28975466b54f229ea6496a2befdfd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1e28975466b54f229ea6496a2befdfd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1e28975466b54f229ea6496a2befdfd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:31:59.001055 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Tenant: admin Aug 24 13:31:59.001055 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Tenant-Id: 1e28975466b54f229ea6496a2befdfd6 Aug 24 13:31:59.001055 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-Tenant-Name: admin Aug 24 13:31:59.001055 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-User: admin Aug 24 13:31:59.001055 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-User-Domain-Id: default Aug 24 13:31:59.001055 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-User-Domain-Name: Default Aug 24 13:31:59.001055 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-User-Id: 23e13f53885b4bcd974e51d34ba1099e Aug 24 13:31:59.001055 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: X-User-Name: admin Aug 24 13:31:59.001055 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: method: > Aug 24 13:31:59.001055 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: exception: Flavor 451 could not be found. Aug 24 13:31:59.001055 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: action_args: {'id': '451'} Aug 24 13:31:59.001055 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:31:59.001055 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:31:59.001848 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 13:31:59.001848 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 13:31:59.001848 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 13:31:59.001848 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 13:31:59.001848 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 13:31:59.001848 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 13:31:59.001848 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 13:31:59.001848 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 13:31:59.001848 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 13:31:59.001848 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:31:59.001848 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 13:31:59.001848 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 13:31:59.001848 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 13:31:59.001848 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi Aug 24 13:31:59.001848 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:31:59.001848 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi Aug 24 13:31:59.001848 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:31:59.001848 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:31:59.001848 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:31:59.003056 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:31:59.003056 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:31:59.003056 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:31:59.003056 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:31:59.003056 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 13:31:59.003056 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:31:59.003056 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 13:31:59.003056 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi Aug 24 13:31:59.003056 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:31:59.003056 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi Aug 24 13:31:59.003056 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:31:59.003056 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:31:59.003056 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:31:59.003056 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:31:59.003056 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:31:59.003056 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 13:31:59.003056 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: ERROR nova.api.openstack.wsgi Aug 24 13:31:59.003056 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-e2f79274-0b20-4eae-969b-46c5ed65c5ae admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:31:59.007264 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-e2f79274-0b20-4eae-969b-46c5ed65c5ae admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.431746 Aug 24 13:31:59.007264 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 25/49] 10.222.0.73 () {60 vars in 1193 bytes} [Wed Aug 24 13:31:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 433 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 13:31:59.010765 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-0081ad3d-f004-495f-be30-ccb9f50f9f1b admin admin] Calling method '>' {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:59.026361 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-0081ad3d-f004-495f-be30-ccb9f50f9f1b admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018632 Aug 24 13:31:59.027342 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 25/50] 10.222.0.73 () {60 vars in 1210 bytes} [Wed Aug 24 13:31:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:31:59.037444 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-112ed869-7d16-4505-8d88-dfee661b676d admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:59.053454 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-112ed869-7d16-4505-8d88-dfee661b676d admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019659 Aug 24 13:31:59.054047 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 26/51] 10.222.0.73 () {60 vars in 1210 bytes} [Wed Aug 24 13:31:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:31:59.063870 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-376c4a61-e64b-459a-9faf-852b22cfc275 admin admin] Calling method '>' {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:31:59.069403 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.wsgi [None req-376c4a61-e64b-459a-9faf-852b22cfc275 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 13:31:59.070900 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-376c4a61-e64b-459a-9faf-852b22cfc275 admin admin] Request method failure captured: Aug 24 13:31:59.070900 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 13:31:59.070900 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: Accept: application/json Aug 24 13:31:59.070900 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: Accept-Encoding: gzip, deflate Aug 24 13:31:59.070900 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: Connection: keep-alive Aug 24 13:31:59.070900 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: Content-Length: 0 Aug 24 13:31:59.070900 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: Host: 10.222.0.73 Aug 24 13:31:59.070900 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: Openstack-Api-Version: compute 2.90 Aug 24 13:31:59.070900 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: Openstack-System-Scope: None Aug 24 13:31:59.070900 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: User-Agent: python-novaclient Aug 24 13:31:59.070900 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Auth-Token: gAAAAABjBihOsOj1k9zY2syjQbyOpqukJMBQvsatFCnM1-wPoZ563YHqsoTPNpuxx_wDhzk_ElXC1oQupWWAj49hgyHLi6tYXn07s259c0Dx_sMzsszoUofYDxX0ObkG-kMGQzjdFePBfbmcncgvVmpJRs9PJ7L2cxwnDq4hYL76KBUitCDyRZU Aug 24 13:31:59.070900 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Domain-Id: None Aug 24 13:31:59.070900 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Domain-Name: None Aug 24 13:31:59.070900 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Identity-Status: Confirmed Aug 24 13:31:59.070900 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Is-Admin-Project: True Aug 24 13:31:59.070900 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 13:31:59.070900 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Project-Domain-Id: default Aug 24 13:31:59.070900 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Project-Domain-Name: Default Aug 24 13:31:59.070900 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Project-Id: 1e28975466b54f229ea6496a2befdfd6 Aug 24 13:31:59.070900 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Project-Name: admin Aug 24 13:31:59.070900 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Role: member,reader,admin Aug 24 13:31:59.070900 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Roles: member,reader,admin Aug 24 13:31:59.072450 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1e28975466b54f229ea6496a2befdfd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1e28975466b54f229ea6496a2befdfd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1e28975466b54f229ea6496a2befdfd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1e28975466b54f229ea6496a2befdfd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:31:59.072450 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Tenant: admin Aug 24 13:31:59.072450 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Tenant-Id: 1e28975466b54f229ea6496a2befdfd6 Aug 24 13:31:59.072450 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-Tenant-Name: admin Aug 24 13:31:59.072450 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-User: admin Aug 24 13:31:59.072450 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-User-Domain-Id: default Aug 24 13:31:59.072450 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-User-Domain-Name: Default Aug 24 13:31:59.072450 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-User-Id: 23e13f53885b4bcd974e51d34ba1099e Aug 24 13:31:59.072450 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: X-User-Name: admin Aug 24 13:31:59.072450 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: method: > Aug 24 13:31:59.072450 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: exception: Flavor 451 could not be found. Aug 24 13:31:59.072450 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: action_args: {'id': '451'} Aug 24 13:31:59.072450 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:31:59.072450 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:31:59.073286 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 13:31:59.073286 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 13:31:59.073286 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 13:31:59.073286 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 13:31:59.073286 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 13:31:59.073286 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 13:31:59.073286 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 13:31:59.073286 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 13:31:59.073286 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 13:31:59.073286 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:31:59.073286 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 13:31:59.073286 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 13:31:59.073286 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 13:31:59.073286 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi Aug 24 13:31:59.073286 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:31:59.073286 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi Aug 24 13:31:59.073286 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:31:59.073286 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:31:59.073286 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:31:59.074448 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:31:59.074448 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:31:59.074448 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:31:59.074448 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:31:59.074448 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 13:31:59.074448 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:31:59.074448 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 13:31:59.074448 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi Aug 24 13:31:59.074448 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:31:59.074448 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi Aug 24 13:31:59.074448 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:31:59.074448 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:31:59.074448 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:31:59.074448 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:31:59.074448 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:31:59.074448 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 13:31:59.074448 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: ERROR nova.api.openstack.wsgi Aug 24 13:31:59.074448 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-376c4a61-e64b-459a-9faf-852b22cfc275 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106201) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:31:59.075482 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-376c4a61-e64b-459a-9faf-852b22cfc275 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011982 Aug 24 13:31:59.075482 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 26/52] 10.222.0.73 () {60 vars in 1193 bytes} [Wed Aug 24 13:31:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 13:32:00.090596 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-112ed869-7d16-4505-8d88-dfee661b676d admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:32:00.091612 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-112ed869-7d16-4505-8d88-dfee661b676d admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Aug 24 13:32:00.092012 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 27/53] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 13:32:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:32:00.651180 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-555f1dda-209d-4e7f-bc09-61d00ee4d6ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:32:00.726927 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-555f1dda-209d-4e7f-bc09-61d00ee4d6ec admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.475656 Aug 24 13:32:00.727489 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 27/54] 10.222.0.73 () {64 vars in 1235 bytes} [Wed Aug 24 13:32:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 13:32:01.741885 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-112ed869-7d16-4505-8d88-dfee661b676d admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:32:01.742910 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-112ed869-7d16-4505-8d88-dfee661b676d admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 24 13:32:01.743315 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 28/55] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 13:32:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:32:02.305775 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-a832fcf6-d995-415b-b321-4763e6e6f5d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:32:02.412298 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-a832fcf6-d995-415b-b321-4763e6e6f5d1 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.519511 Aug 24 13:32:02.412864 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 28/56] 10.222.0.73 () {64 vars in 1235 bytes} [Wed Aug 24 13:32:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 13:32:03.415232 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-112ed869-7d16-4505-8d88-dfee661b676d admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:32:03.416289 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-112ed869-7d16-4505-8d88-dfee661b676d admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 24 13:32:03.416855 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 29/57] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 13:32:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:32:04.006848 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-63ccb593-33e3-4c99-afd6-00667262e659 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:32:04.125408 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-63ccb593-33e3-4c99-afd6-00667262e659 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.570589 Aug 24 13:32:04.125881 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 29/58] 10.222.0.73 () {64 vars in 1235 bytes} [Wed Aug 24 13:32:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 13:32:05.108159 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-112ed869-7d16-4505-8d88-dfee661b676d admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:32:05.109191 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-112ed869-7d16-4505-8d88-dfee661b676d admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 24 13:32:05.109587 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 30/59] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 13:32:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:32:05.672401 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-1dedd5d6-b4cd-4e91-85b0-fcfe3bacfd9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:32:05.750276 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-1dedd5d6-b4cd-4e91-85b0-fcfe3bacfd9c admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.500574 Aug 24 13:32:05.751075 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 30/60] 10.222.0.73 () {64 vars in 1235 bytes} [Wed Aug 24 13:32:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 13:32:06.749926 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-112ed869-7d16-4505-8d88-dfee661b676d admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:32:06.750944 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-112ed869-7d16-4505-8d88-dfee661b676d admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 24 13:32:06.751347 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 31/61] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 13:32:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:32:07.301714 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-1f30ae46-06f5-4866-8f3f-677d5301ee8b admin admin] Calling method '>' {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:32:07.322824 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-1f30ae46-06f5-4866-8f3f-677d5301ee8b admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.433073 Aug 24 13:32:07.323385 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 31/62] 10.222.0.73 () {60 vars in 1202 bytes} [Wed Aug 24 13:32:06 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:33:03.684495 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-112ed869-7d16-4505-8d88-dfee661b676d admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:33:03.685510 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-112ed869-7d16-4505-8d88-dfee661b676d admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 24 13:33:03.685909 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 32/63] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 13:33:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:33:03.698458 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG dbcounter [-] [106201] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:33:04.106579 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-17245964-485f-4e49-a99e-8329c7ff8d8e admin admin] Calling method '>' {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:33:04.127594 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-17245964-485f-4e49-a99e-8329c7ff8d8e admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.434538 Aug 24 13:33:04.128141 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 32/64] 10.222.0.73 () {60 vars in 1292 bytes} [Wed Aug 24 13:33:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:33:04.149578 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG dbcounter [-] [106200] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106200) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:33:04.153316 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-406555c2-0a19-4b73-b32f-19d9a2ce445e admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:33:04.160818 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-406555c2-0a19-4b73-b32f-19d9a2ce445e admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012970 Aug 24 13:33:04.165083 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 33/65] 10.222.0.73 () {60 vars in 1283 bytes} [Wed Aug 24 13:33:04 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:33:04.174218 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-6fe45303-168b-45b4-b8d4-2fa02b8a1a72 admin admin] Calling method '>' {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:33:04.183170 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-6fe45303-168b-45b4-b8d4-2fa02b8a1a72 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012691 Aug 24 13:33:04.183875 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 33/66] 10.222.0.73 () {60 vars in 1286 bytes} [Wed Aug 24 13:33:04 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:33:04.195748 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-e4756c02-9ead-499a-a0a9-5f5ca2bb54f9 admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:33:04.211842 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-e4756c02-9ead-499a-a0a9-5f5ca2bb54f9 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019857 Aug 24 13:33:04.212374 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 34/67] 10.222.0.73 () {60 vars in 1286 bytes} [Wed Aug 24 13:33:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:33:04.224512 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-df32dbe7-5963-447c-ae59-09117aac64e7 admin admin] Calling method '>' {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:33:04.232805 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-df32dbe7-5963-447c-ae59-09117aac64e7 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011943 Aug 24 13:33:04.233334 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 34/68] 10.222.0.73 () {60 vars in 1283 bytes} [Wed Aug 24 13:33:04 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:36:11.313644 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-e4756c02-9ead-499a-a0a9-5f5ca2bb54f9 admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:36:11.315126 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-e4756c02-9ead-499a-a0a9-5f5ca2bb54f9 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001987 Aug 24 13:36:11.315676 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 35/69] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 13:36:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:36:11.464365 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG dbcounter [-] [106201] Writing DB stats nova_api:SELECT=6 {{(pid=106201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:36:11.663562 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-4154cfe9-4fb4-482b-ae2a-13316244316c admin admin] Calling method '>' {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:36:11.668325 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 13:36:11.668325 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: warnings.warn(msg) Aug 24 13:36:11.670700 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-4154cfe9-4fb4-482b-ae2a-13316244316c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:36:11.671595 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-4154cfe9-4fb4-482b-ae2a-13316244316c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:36:11.672499 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-4154cfe9-4fb4-482b-ae2a-13316244316c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:36:11.673902 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-4154cfe9-4fb4-482b-ae2a-13316244316c admin admin] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:36:11.674710 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-4154cfe9-4fb4-482b-ae2a-13316244316c admin admin] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:36:11.675695 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-4154cfe9-4fb4-482b-ae2a-13316244316c admin admin] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:36:11.756105 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-4154cfe9-4fb4-482b-ae2a-13316244316c admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.292436 Aug 24 13:36:11.757066 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 35/70] 10.222.0.73 () {60 vars in 1193 bytes} [Wed Aug 24 13:36:11 2022] GET /compute/v2.1/os-services => generated 791 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 13:36:12.686689 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-e4756c02-9ead-499a-a0a9-5f5ca2bb54f9 admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:36:12.687913 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-e4756c02-9ead-499a-a0a9-5f5ca2bb54f9 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Aug 24 13:36:12.688455 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 36/71] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 13:36:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:36:12.925797 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-846f504a-1f8c-4276-98d6-616be6c822f4 admin admin] Calling method '>' {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:36:12.929708 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 13:36:12.929708 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: warnings.warn(msg) Aug 24 13:36:12.931288 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-846f504a-1f8c-4276-98d6-616be6c822f4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:36:12.931955 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-846f504a-1f8c-4276-98d6-616be6c822f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:36:12.932889 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-846f504a-1f8c-4276-98d6-616be6c822f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:36:12.933955 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-846f504a-1f8c-4276-98d6-616be6c822f4 admin admin] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:36:12.934605 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-846f504a-1f8c-4276-98d6-616be6c822f4 admin admin] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:36:12.935168 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-846f504a-1f8c-4276-98d6-616be6c822f4 admin admin] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:36:12.962327 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-846f504a-1f8c-4276-98d6-616be6c822f4 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.109047 Aug 24 13:36:12.965226 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 36/72] 10.222.0.73 () {60 vars in 1193 bytes} [Wed Aug 24 13:36:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 13:36:24.292383 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-e4756c02-9ead-499a-a0a9-5f5ca2bb54f9 admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:36:24.293454 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-e4756c02-9ead-499a-a0a9-5f5ca2bb54f9 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 24 13:36:24.293857 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 37/73] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 13:36:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:36:24.443941 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG dbcounter [-] [106201] Writing DB stats nova_cell0:SELECT=4 {{(pid=106201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:36:24.444791 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG dbcounter [-] [106201] Writing DB stats nova_cell1:SELECT=4 {{(pid=106201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:36:24.445386 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG dbcounter [-] [106201] Writing DB stats nova_api:SELECT=8 {{(pid=106201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:36:24.499436 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-f26c5e89-2a2b-4ed9-95ca-02685afef735 admin admin] Calling method '>' {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:36:24.501878 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 13:36:24.501878 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: warnings.warn(msg) Aug 24 13:36:24.503003 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-f26c5e89-2a2b-4ed9-95ca-02685afef735 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:36:24.503482 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-f26c5e89-2a2b-4ed9-95ca-02685afef735 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:36:24.503912 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-f26c5e89-2a2b-4ed9-95ca-02685afef735 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:36:24.504853 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-f26c5e89-2a2b-4ed9-95ca-02685afef735 admin admin] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:36:24.505435 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-f26c5e89-2a2b-4ed9-95ca-02685afef735 admin admin] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:36:24.505861 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-f26c5e89-2a2b-4ed9-95ca-02685afef735 admin admin] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:36:24.531870 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-f26c5e89-2a2b-4ed9-95ca-02685afef735 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.092816 Aug 24 13:36:24.532509 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 37/74] 10.222.0.73 () {60 vars in 1193 bytes} [Wed Aug 24 13:36:24 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:36:25.416344 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: DEBUG nova.api.openstack.wsgi [None req-e4756c02-9ead-499a-a0a9-5f5ca2bb54f9 admin admin] Calling method '>' {{(pid=106200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:36:25.417416 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: INFO nova.api.openstack.requestlog [None req-e4756c02-9ead-499a-a0a9-5f5ca2bb54f9 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Aug 24 13:36:25.418015 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: [pid: 106200|app: 0|req: 38/75] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 13:36:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:36:25.634666 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG nova.api.openstack.wsgi [None req-6acd7ea0-15e6-4f5f-afd5-cf368fc7792b admin admin] Calling method '>' {{(pid=106201) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:36:25.637137 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 13:36:25.637137 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: warnings.warn(msg) Aug 24 13:36:25.638249 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-6acd7ea0-15e6-4f5f-afd5-cf368fc7792b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:36:25.638759 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-6acd7ea0-15e6-4f5f-afd5-cf368fc7792b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:36:25.639188 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-6acd7ea0-15e6-4f5f-afd5-cf368fc7792b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:36:25.639909 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-6acd7ea0-15e6-4f5f-afd5-cf368fc7792b admin admin] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:36:25.640387 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-6acd7ea0-15e6-4f5f-afd5-cf368fc7792b admin admin] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:36:25.640806 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: DEBUG oslo_concurrency.lockutils [None req-6acd7ea0-15e6-4f5f-afd5-cf368fc7792b admin admin] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106201) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:36:25.664085 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: INFO nova.api.openstack.requestlog [None req-6acd7ea0-15e6-4f5f-afd5-cf368fc7792b admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.092353 Aug 24 13:36:25.664739 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: [pid: 106201|app: 0|req: 38/76] 10.222.0.73 () {60 vars in 1193 bytes} [Wed Aug 24 13:36:25 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:37:23.460350 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: Wed Aug 24 13:37:23 2022 - graceful shutdown triggered... Aug 24 13:37:23.460474 dv-cinder-779578-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 13:37:23.461335 dv-cinder-779578-4-iscsi devstack@n-api.service[106200]: Gracefully killing worker 1 (pid: 106200)... Aug 24 13:37:23.461714 dv-cinder-779578-4-iscsi devstack@n-api.service[106201]: Gracefully killing worker 2 (pid: 106201)... Aug 24 13:37:24.462400 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: worker 1 buried after 1 seconds Aug 24 13:37:24.462400 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: worker 2 buried after 1 seconds Aug 24 13:37:24.462400 dv-cinder-779578-4-iscsi devstack@n-api.service[106199]: goodbye to uWSGI. Aug 24 13:37:24.463845 dv-cinder-779578-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 13:37:24.464429 dv-cinder-779578-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 13:37:24.467206 dv-cinder-779578-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 13:37:24.482121 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 13:37:24.484666 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 13:37:24 2022] *** Aug 24 13:37:24.484666 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 13:37:24.484666 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 13:37:24.484666 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: nodename: dv-cinder-779578-4-iscsi Aug 24 13:37:24.484666 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: machine: x86_64 Aug 24 13:37:24.484666 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: clock source: unix Aug 24 13:37:24.484666 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: pcre jit disabled Aug 24 13:37:24.484666 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: detected number of CPU cores: 4 Aug 24 13:37:24.484666 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: current working directory: / Aug 24 13:37:24.484666 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: detected binary path: /usr/bin/uwsgi-core Aug 24 13:37:24.484666 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: your processes number limit is 47680 Aug 24 13:37:24.484666 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: your memory page size is 4096 bytes Aug 24 13:37:24.485588 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: detected max file descriptor number: 2048 Aug 24 13:37:24.485588 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: lock engine: pthread robust mutexes Aug 24 13:37:24.485588 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: thunder lock: enabled Aug 24 13:37:24.485588 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 13:37:24.485588 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 13:37:24.529246 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: Python main interpreter initialized at 0x561b80abc9c0 Aug 24 13:37:24.529246 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: python threads support enabled Aug 24 13:37:24.529246 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: your server socket listen backlog is limited to 100 connections Aug 24 13:37:24.529246 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: your mercy for graceful operations on workers is 90 seconds Aug 24 13:37:24.529673 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 13:37:24.529673 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: *** Operational MODE: preforking *** Aug 24 13:37:24.529984 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: *** uWSGI is running in multiple interpreter mode *** Aug 24 13:37:24.529984 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: spawned uWSGI master process (pid: 132988) Aug 24 13:37:24.530210 dv-cinder-779578-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 13:37:24.531049 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: spawned uWSGI worker 1 (pid: 133014, cores: 1) Aug 24 13:37:24.531442 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: spawned uWSGI worker 2 (pid: 133015, cores: 1) Aug 24 13:37:24.531631 dv-cinder-779578-4-iscsi devstack@n-api.service[132988]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 13:37:25.233123 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 13:37:25.250348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 13:37:26.480299 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 13:37:26.480299 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: from cryptography.utils import int_from_bytes Aug 24 13:37:26.481270 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 13:37:26.481270 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: from cryptography.utils import int_from_bytes Aug 24 13:37:26.520588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 13:37:26.520588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: from cryptography.utils import int_from_bytes Aug 24 13:37:26.521180 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 13:37:26.521180 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: from cryptography.utils import int_from_bytes Aug 24 13:37:29.109865 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 13:37:29.110491 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 13:37:29.110674 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 13:37:29.111076 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 13:37:29.111319 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 13:37:29.111729 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.112063 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.112420 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.112870 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.113835 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.114003 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.114213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.114508 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.114853 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.115121 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.115444 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.115776 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-779578-4-iscsi {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.116104 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.116454 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.116775 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.117104 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.117416 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.117745 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.118053 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.118577 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.120635 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.120635 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.120635 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.120635 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.122151 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.122151 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.122151 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.122151 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.122151 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.123795 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.123795 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-779578-4-iscsi {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.123795 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.123795 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.123795 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.125117 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.125117 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.125117 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.125117 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.125770 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.125770 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.126137 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.126137 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.126480 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.126811 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.127121 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.127435 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.127754 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.128077 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.129063 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.129377 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.129635 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.129951 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.130289 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.130621 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.130951 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.131206 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.131447 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.131771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.132101 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.132522 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.132835 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.133144 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.133457 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.133963 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.134158 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.134427 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.134802 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.135150 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.135406 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.135714 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.136024 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.136386 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.136806 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.137058 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.137371 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.137721 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.138050 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.138404 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.138690 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.139016 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.139327 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.139637 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.139949 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.140307 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.140655 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.140968 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.141224 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.141534 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.141841 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.142165 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.142476 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.142785 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.143092 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.143399 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.143706 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.144936 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.145263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.145717 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.145911 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.146192 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.146503 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.146813 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.147124 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.147462 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.147791 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.148098 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.148443 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.148752 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.149063 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.149393 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.149702 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.150070 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.150353 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.150647 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.150962 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.151291 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.151602 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.151909 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.152312 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.152570 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.152883 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.153205 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.153514 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.153822 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.154129 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.154434 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.154743 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.155052 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.155363 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.155665 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.155967 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.156319 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.156651 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.156965 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.157274 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.157579 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.157906 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.158249 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.158585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.158939 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.159254 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.159622 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.160062 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.160324 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.160617 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.160937 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.161270 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.161587 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.161936 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.162218 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.162545 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.162865 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.163205 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.163600 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.163922 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.164271 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.164592 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.164912 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.165448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.165620 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.165881 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.166228 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.166585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.166901 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.167233 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.167565 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.167885 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.168220 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.168541 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.168870 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.169210 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.169526 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.169851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.170168 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.170489 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.170803 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.171118 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.171431 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.171785 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.172103 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.172466 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.172784 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.173106 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.173420 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.173735 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.174048 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.174357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.174665 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.174970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.175330 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.175621 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.175945 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.176311 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.176626 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.176970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.177282 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.177619 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.177910 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.178224 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.178533 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.178850 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.179165 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.179473 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.179806 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.180122 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.180465 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.180791 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.181101 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.181408 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.181727 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.182042 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.182353 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.182933 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.183250 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.183584 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.183902 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.184266 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.184577 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.184968 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.185239 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.185531 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.185862 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.186183 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.186491 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.186805 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.187152 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.187417 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.187723 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.188038 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.188368 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.188676 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.188982 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.189287 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.189591 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.189921 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.190239 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.190670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.191711 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.192027 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.192415 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.192724 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.193077 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.193421 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.193748 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.194078 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.194396 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.194717 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.195033 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.195350 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.195665 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.195980 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.196409 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.196731 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.197055 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.197369 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.197701 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.198034 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.198321 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.198659 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.198977 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.199321 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.199664 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.199980 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.200332 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.200647 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.201047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.201296 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.201573 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.201889 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.202204 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.202524 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.202836 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.203158 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.203467 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.203794 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.204088 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 13:37:29.204807 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.204987 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 13:37:29.205153 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.205153 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.205470 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 13:37:29.205626 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.205858 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 13:37:29.206032 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.206258 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 13:37:29.206496 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.207221 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.207431 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.207636 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.207843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.208063 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.208313 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.208313 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.208727 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.208887 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.209041 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.209214 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.209377 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.209527 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.209673 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.209821 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.209986 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.210152 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.210316 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.210463 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.210619 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.210841 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.211092 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.211267 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.211438 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-779578-4-iscsi {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.211601 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.211760 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.211908 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.211908 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.212273 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.212499 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.212658 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.212807 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.212955 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.213113 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.213277 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.213495 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.213703 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.213858 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.214073 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.214237 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.214409 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.214590 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.214753 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.214901 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.215052 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.215222 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.215374 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.215540 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.215540 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.215834 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.216054 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.216248 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.216464 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.216616 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.216782 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.216942 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.217092 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.217262 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.217493 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.217704 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.217859 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.218061 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.218297 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.218463 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-779578-4-iscsi {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.218688 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.218849 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.218998 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.219161 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.219314 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.219459 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.219620 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.219620 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.219977 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.220160 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.220386 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.220554 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.220709 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.220865 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.221017 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.221182 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.221345 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.221504 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.221664 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.221815 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.221973 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.222167 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.222318 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.222477 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.222690 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.222842 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.223059 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.223215 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.223367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.223586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.223738 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.223941 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.224117 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.224364 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.224530 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.224725 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.224873 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.224873 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.225155 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.225314 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.225475 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.225644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.225792 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.225951 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.226120 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.226343 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.226552 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.226703 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.226929 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.227156 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.227376 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.227595 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.227818 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.228033 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.228329 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.228563 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.228809 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.229029 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.229262 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.229475 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.229634 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.229788 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.229941 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.230091 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.230368 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.230520 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.230662 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.230818 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.230968 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.231116 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.231281 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.231434 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.231586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.231738 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.231903 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.232071 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.232247 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.232415 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.232590 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.232742 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.232968 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.233148 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.233317 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.233478 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.233629 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.233854 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.234013 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.234242 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.234400 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.234566 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.234721 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.234886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.235041 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.235205 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.235353 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.235554 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.235722 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.235891 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.236059 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.236281 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.236516 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.236672 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.236880 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.237047 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.237216 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.237423 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.237590 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.237814 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.237961 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.238176 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.238469 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.238682 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.238906 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.239172 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.239397 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.239641 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.239864 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.240075 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.240324 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.240550 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.240777 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.241059 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.241282 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.241506 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.241721 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.241933 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.242217 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.242599 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.242816 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.243064 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.243275 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.243499 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.243712 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.243934 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.244250 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.244481 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.244687 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.244904 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.245153 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.245379 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.245601 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.245848 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.246056 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.246265 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.246473 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.246690 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.246905 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.247122 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.247337 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.247659 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.247913 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.248134 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.248362 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.248589 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.248795 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.248795 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.249219 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.249440 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.249657 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.249874 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.250086 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.250292 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.250501 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.250705 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.250911 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.251130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.251336 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.251553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.251772 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.251929 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.252093 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.252328 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.252480 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.252655 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.252816 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.252976 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.253136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.253814 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.254039 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.254246 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.254396 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.254617 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.254797 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.254960 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.255114 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.255267 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.255430 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.255577 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.255740 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.255902 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.256052 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.256233 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.256386 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.256552 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.256715 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.256932 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.257100 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.257313 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.257485 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.257653 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.257805 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.257967 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.258122 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.258285 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.258447 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.258611 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.258779 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.258943 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.258943 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.259372 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.259541 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.259718 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.259930 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.260158 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 13:37:29.260372 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.260528 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.260682 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.260855 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.261008 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.261172 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.261336 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.261485 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.261652 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.261807 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.261961 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.262119 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.262273 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.262433 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.262596 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.262750 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.262915 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.263068 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.263232 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.263386 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.263562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.263717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.263878 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.264039 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.264039 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.264502 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.264676 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.264894 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.265052 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.265206 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.265417 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.265747 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.265962 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.266174 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.266386 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.266544 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.266699 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.266880 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.267034 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.267186 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.267346 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.267559 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.267729 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.267897 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.267897 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.268242 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.268242 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.268548 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.268548 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.268942 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.269645 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.269874 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.270046 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.270200 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.270438 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.270652 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.270811 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.270975 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.271129 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.271289 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.271463 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.271628 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.271791 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.271942 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.272091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.272275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.272452 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.272609 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.272757 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.272914 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.273072 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.273226 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.273398 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.273551 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.273705 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.273877 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.274033 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.274209 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.274428 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.274642 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.274795 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.275016 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.275174 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.275174 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.275545 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.275699 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.275852 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.276037 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.276267 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.276443 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.276600 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.276754 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.276915 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.277130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.277301 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.277301 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.277613 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.277781 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.277947 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.278113 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.278283 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.278439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.278590 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.278745 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.278897 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.279050 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.279217 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.279370 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.279536 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.279703 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.279868 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.279868 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.280332 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.280332 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.280709 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.280921 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.281098 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.281249 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.281413 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.281413 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.281702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.281964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.282135 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.282300 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.282300 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.282585 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.282752 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.282907 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.283061 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.283235 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.283398 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.283551 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.283716 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.283865 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.284030 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.284264 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.284422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.284669 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.284886 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.285061 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.285289 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.285527 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.285698 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.285863 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.286026 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.286179 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.286348 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.286516 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.286681 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.286835 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.286989 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.287155 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.287387 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.287568 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.287736 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.287892 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.288041 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.288219 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.288457 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.288682 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.288847 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.289047 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.289271 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.289506 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.289731 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.289955 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.290164 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.290375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.290603 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.290783 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.291000 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.291209 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.291427 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.291578 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.291738 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.291905 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.292055 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.292241 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.292436 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.292592 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.292761 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.292925 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.293085 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.293249 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.293403 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.293568 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.293799 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.293954 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.294117 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.294279 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.294432 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.294576 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.294730 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.294870 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.295088 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.295309 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.295466 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.295687 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.295861 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.296014 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.296145 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.296358 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.296505 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.296668 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.296827 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.296975 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.297141 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.297373 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.297584 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.297810 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.297963 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.298185 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.298339 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.298502 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.298662 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.298662 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.299012 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.299222 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.299430 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.299638 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.299788 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.299952 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.300114 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.300382 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.300615 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.300826 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.300826 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.301188 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.301405 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.301629 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.301845 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.301997 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.302148 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.302429 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.302598 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.302762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.302925 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.303076 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.303240 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.303393 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.303545 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.303697 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.303861 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.304031 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.304263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.304418 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.304630 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.304839 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.304996 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.305171 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.305171 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.305646 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.305806 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.306024 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.306186 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.306362 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.306531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.306685 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.306836 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.306985 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.306985 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.307300 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.307453 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.307879 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.308097 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.308321 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.308478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.308658 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.308814 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.308977 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.309130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.309281 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.309468 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.309645 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.309805 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.309954 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.310104 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.310265 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.310492 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.310832 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.311047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.311266 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.311421 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.311588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.311829 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.312072 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.312332 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.312502 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.312669 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.312830 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.313005 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.313166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.313319 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.313470 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.313634 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.313788 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.313955 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.314110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.314262 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.314415 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.314562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.314712 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.314943 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.315104 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.315229 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.315327 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.315411 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.315504 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.315643 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.316405 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.316676 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.316899 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.317065 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.317236 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.317409 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.317574 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.317733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.317880 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.318037 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.318210 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.318435 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.318584 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.318729 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.318880 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.319041 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.319209 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.319401 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.319515 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.319656 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.319760 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.319867 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.319996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.320147 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.320333 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.320505 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.320674 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.320907 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.321072 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.321236 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.321413 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.321626 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.321781 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.321957 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.322157 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.322346 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.322561 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.322713 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.322867 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.323034 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.323188 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.323340 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.323495 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.323643 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.323811 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.323989 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.324147 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.324384 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.324540 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.324692 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.324872 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.325060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.325209 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.325362 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.325517 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.325517 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.325837 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.326059 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.326229 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.326229 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.326512 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.326669 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.326872 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.327128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.327296 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.327463 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.327634 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.327817 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.327973 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.328126 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.328298 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.328440 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.328648 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.328872 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.329081 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.329236 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.329395 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.329559 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.329730 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.329866 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.330027 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.330179 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.330332 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.330497 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.330671 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.330839 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.331155 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.331311 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.331311 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.331773 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.332549 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.332788 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.332951 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.333100 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.333100 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.333392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.333562 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.333715 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.333864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.334031 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.334187 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.334424 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.334582 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.334737 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.334886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.335039 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.335302 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.335471 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.335620 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.335781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.335945 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.336256 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.336392 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.336482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.336568 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.336653 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.336808 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.336926 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.337039 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.337114 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.337193 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.337339 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.337434 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.337508 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.338260 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.338392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.338485 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.338578 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.338677 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.338779 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.338935 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.338935 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.339282 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.339452 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.339615 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.339769 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.339925 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.340098 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.340300 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.340462 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.340623 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.340789 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.340957 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.341107 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.341264 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.341469 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.341632 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.341787 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.341922 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.342177 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.342333 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.342492 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.342654 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.342805 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.342958 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.343115 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.343283 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.343603 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.343763 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.343918 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.344074 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.344278 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.344459 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.344459 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.344761 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.344930 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.345105 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.345277 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.345491 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.345665 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.345817 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.345967 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.346138 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.346286 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.346447 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.346618 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.346784 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.346940 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.347137 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.347352 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.347553 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.347749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.347900 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.348106 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.348448 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.348615 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.348752 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.348898 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.349049 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.349262 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.349439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.349604 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.349767 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.349922 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.350076 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.350248 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.350414 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.350567 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.350703 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.350794 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.350794 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.351308 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.351308 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.351551 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.351551 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.351779 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.351779 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.351966 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.352122 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.352317 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.352425 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.352514 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.352591 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.352685 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.352778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.352862 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.352945 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.353024 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.353105 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.353179 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.353256 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.353328 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.353411 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.353411 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.353618 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.353705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.353797 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.353889 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.353982 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.354066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.354153 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.354246 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.354331 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.354415 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.354502 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.354584 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.354672 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.354755 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.354886 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.354976 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.355108 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.355205 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.355291 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.355383 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.355474 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.355547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.355625 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.355765 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.355860 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.355993 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.356083 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.356155 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.356290 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.356396 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.356524 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.356617 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.356694 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.356776 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.356863 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.356948 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.357079 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.357168 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.357297 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.357400 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.357485 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.357565 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.357689 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.357811 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.357942 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.358065 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.358172 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.358254 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.358345 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.358438 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.358530 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.358621 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.358714 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.358799 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.358883 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.358966 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.359050 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.359184 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.359310 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.359449 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.359540 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.359540 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.359768 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.359906 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.359997 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.360127 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.360245 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.360386 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.360386 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.360608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.360707 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.360793 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.360793 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.360996 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.361136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.361236 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.361328 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.361420 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.361494 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.361564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.361696 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.361798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.361884 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.361967 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.362049 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.362132 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.362265 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.362366 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.362452 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.362543 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.362664 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.362765 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.362859 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.362947 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.363186 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.363330 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.363458 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.363561 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.363656 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.363778 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.363906 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.363999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.364083 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.364283 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.364374 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.364465 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.364550 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.364633 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.364716 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.364813 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.364898 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.364987 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.365079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.365171 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.365257 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.365349 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.365435 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.365539 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.365625 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.365757 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.365757 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.365939 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.366026 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.366108 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.366192 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.366274 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.366365 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.366457 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.366542 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.366631 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.366722 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.366806 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.366902 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.366994 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.367078 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.367161 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.367250 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.367341 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.367435 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.367521 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.367653 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.367746 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.367831 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.367831 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.367997 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.368114 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.368320 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.368412 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.368503 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.368764 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.368871 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.368966 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.369058 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.369144 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.369239 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.369341 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.369473 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.369575 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.369674 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.369767 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.369859 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.369941 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.370020 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.370109 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.370189 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.370189 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.370388 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.370388 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.370608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.370697 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.370788 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.370873 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.370965 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.371050 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.371140 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.371233 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.371325 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.371410 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.371503 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.371503 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.371644 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.371716 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.371809 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.371902 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.372004 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.372004 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.372160 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.372322 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.372451 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.372555 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.372642 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.372727 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.372817 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.372903 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.372986 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.373082 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.373168 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.373251 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.373334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.373465 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.373556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.373638 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.373771 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.373860 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.373945 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.374036 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.374135 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.374221 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.374304 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.374393 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.374479 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.374551 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.374551 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.374714 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.374799 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.374871 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.374948 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.375030 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.375030 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.375177 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.375177 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.375346 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.375443 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.375540 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.375666 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.375766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.375766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.375766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.376055 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.376152 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.376262 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.376353 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.376437 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.376519 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.376619 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.376718 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.376815 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.376899 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.376982 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.377064 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.377136 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.377263 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.377403 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.377506 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.377578 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.377660 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.377804 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.377906 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.378009 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.378147 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.378241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 13:37:29.378860 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.378860 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.378860 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.378860 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.378860 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.378860 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.379232 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.379475 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.379801 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.380136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.380498 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.380815 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.381149 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.381472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.381938 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.382102 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.382420 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.383168 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.383168 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.384495 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.384495 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.384495 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.384495 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.385016 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.385162 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.385379 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.385695 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.386031 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.386352 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.386665 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.386981 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.387298 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.387613 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.387930 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.388275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.388593 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.388907 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.389220 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.389557 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.389863 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.390200 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.390517 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.390837 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.391149 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.391456 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.391812 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.392123 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.392491 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.392815 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.393149 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.393477 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.393802 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.394704 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.395033 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.395358 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.395679 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.396004 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.396345 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.396671 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.396999 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.397327 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.397915 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.398255 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.398584 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.398915 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.399242 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.399568 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.399890 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.400244 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.400571 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.400895 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.401217 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.401557 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.401891 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.402233 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.402583 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.402920 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.403243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.403569 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.403892 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.404286 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.404614 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.404933 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.405258 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.405588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.405913 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.406231 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.406548 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.406876 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.407204 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.407528 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.407848 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.408174 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.408519 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.408854 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.409204 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.409574 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.409905 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.410269 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.410580 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.411153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.411480 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.411826 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.412156 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.412521 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.412849 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.413176 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.413510 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.413835 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.414145 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.414465 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.414782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.415097 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.415430 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.415751 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.416060 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.416416 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.416740 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.417405 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.417762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.418097 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.418433 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.418769 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.419096 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.419409 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.419744 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.420062 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.420492 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.420822 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.421142 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.421460 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.421777 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.422096 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.422410 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.422723 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.423044 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.423366 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.423701 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.424013 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.424347 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.424660 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.424981 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.425895 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.426217 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.426531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.426966 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.427295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.427613 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.427932 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.428271 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.428597 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.428916 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.429237 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.429552 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.429891 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.430205 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.430571 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.430906 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.431230 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.431563 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.431888 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.432227 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.432865 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.433195 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.433786 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.434132 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.434466 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.434820 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.435163 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.435481 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.435805 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.436133 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.436530 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.436860 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.437180 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.437502 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.437824 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.438144 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.438465 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.438787 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.439110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.439430 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.439793 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.440118 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.440468 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.440899 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.441901 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.442008 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO dbcounter [None req-21e23b53-92a7-4cda-9385-ddb69cb3ab56 None None] Registered counter for database nova_api Aug 24 13:37:29.442287 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.442662 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.443000 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.443325 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.443656 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.443985 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.444344 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.444671 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.444996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.445315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.445643 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.445984 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.446307 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.446626 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.447067 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.447388 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.447715 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.448046 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.448392 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.448727 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.449063 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.449385 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.449712 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.450033 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.450372 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.450717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.451059 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.451416 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.451716 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.452024 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.452368 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.452689 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.453015 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.453342 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.453644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.453965 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.454279 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.454597 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.454911 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.455217 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.455527 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.455849 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.456199 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.456554 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.456886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.457175 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.457483 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.458080 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.458575 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.459074 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.459386 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.459710 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.460021 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.460367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.460730 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.461084 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.461416 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.461929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.462260 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.462600 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.462931 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.463268 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.463631 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.463795 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_db.sqlalchemy.engines [None req-21e23b53-92a7-4cda-9385-ddb69cb3ab56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133015) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 13:37:29.463945 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.464292 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.464803 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.464967 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.465284 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.465607 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.466068 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.466334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.467513 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.467972 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.468311 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.468757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.469247 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.469429 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.469587 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.469926 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.470260 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.470598 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.471014 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.471994 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writer thread running {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 13:37:29.472545 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.472816 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.473168 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.473488 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.473803 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.474129 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.474453 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.474780 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.475107 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.475446 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.475791 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.476104 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.476519 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.476902 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.477279 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.477607 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.478008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.478295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.478616 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.478938 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.479252 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 13:37:29.479501 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 13:37:29.532750 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.context [None req-21e23b53-92a7-4cda-9385-ddb69cb3ab56 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),61617dbb-81a0-4cba-8ce2-26c27e8678f7(cell1) {{(pid=133015) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 13:37:29.537122 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-21e23b53-92a7-4cda-9385-ddb69cb3ab56 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:37:29.537677 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-21e23b53-92a7-4cda-9385-ddb69cb3ab56 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:37:29.539312 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-21e23b53-92a7-4cda-9385-ddb69cb3ab56 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:37:29.540263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-21e23b53-92a7-4cda-9385-ddb69cb3ab56 None None] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:37:29.540789 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-21e23b53-92a7-4cda-9385-ddb69cb3ab56 None None] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:37:29.546483 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO dbcounter [None req-7cdd5993-10b0-4135-bfb1-37627f8413d9 None None] Registered counter for database nova_api Aug 24 13:37:29.546685 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-21e23b53-92a7-4cda-9385-ddb69cb3ab56 None None] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:37:29.546685 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO dbcounter [None req-21e23b53-92a7-4cda-9385-ddb69cb3ab56 None None] Registered counter for database nova_cell0 Aug 24 13:37:29.549946 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO dbcounter [None req-21e23b53-92a7-4cda-9385-ddb69cb3ab56 None None] Registered counter for database nova_cell1 Aug 24 13:37:29.562155 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_db.sqlalchemy.engines [None req-21e23b53-92a7-4cda-9385-ddb69cb3ab56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133015) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 13:37:29.563904 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_db.sqlalchemy.engines [None req-21e23b53-92a7-4cda-9385-ddb69cb3ab56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133015) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 13:37:29.568413 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_db.sqlalchemy.engines [None req-7cdd5993-10b0-4135-bfb1-37627f8413d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133014) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 13:37:29.571645 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writer thread running {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 13:37:29.574051 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writer thread running {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 13:37:29.576575 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writer thread running {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 13:37:29.656683 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.context [None req-7cdd5993-10b0-4135-bfb1-37627f8413d9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),61617dbb-81a0-4cba-8ce2-26c27e8678f7(cell1) {{(pid=133014) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 13:37:29.664976 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7cdd5993-10b0-4135-bfb1-37627f8413d9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:37:29.665832 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7cdd5993-10b0-4135-bfb1-37627f8413d9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:37:29.669333 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7cdd5993-10b0-4135-bfb1-37627f8413d9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:37:29.670773 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7cdd5993-10b0-4135-bfb1-37627f8413d9 None None] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:37:29.671616 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7cdd5993-10b0-4135-bfb1-37627f8413d9 None None] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:37:29.677026 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7cdd5993-10b0-4135-bfb1-37627f8413d9 None None] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:37:29.680395 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO dbcounter [None req-7cdd5993-10b0-4135-bfb1-37627f8413d9 None None] Registered counter for database nova_cell0 Aug 24 13:37:29.688869 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO dbcounter [None req-7cdd5993-10b0-4135-bfb1-37627f8413d9 None None] Registered counter for database nova_cell1 Aug 24 13:37:29.701044 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_db.sqlalchemy.engines [None req-7cdd5993-10b0-4135-bfb1-37627f8413d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133014) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 13:37:29.704150 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_db.sqlalchemy.engines [None req-7cdd5993-10b0-4135-bfb1-37627f8413d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133014) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 13:37:29.717223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writer thread running {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 13:37:29.719579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writer thread running {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 13:37:29.729535 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO dbcounter [None req-21e23b53-92a7-4cda-9385-ddb69cb3ab56 None None] Registered counter for database nova_cell0 Aug 24 13:37:29.736954 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_db.sqlalchemy.engines [None req-21e23b53-92a7-4cda-9385-ddb69cb3ab56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133015) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 13:37:29.744487 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writer thread running {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 13:37:30.016799 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO dbcounter [None req-7cdd5993-10b0-4135-bfb1-37627f8413d9 None None] Registered counter for database nova_cell0 Aug 24 13:37:30.028836 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_db.sqlalchemy.engines [None req-7cdd5993-10b0-4135-bfb1-37627f8413d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133014) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 13:37:30.035347 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writer thread running {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 13:37:30.137422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: WARNING keystonemiddleware.auth_token [None req-21e23b53-92a7-4cda-9385-ddb69cb3ab56 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 13:37:30.146204 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: WARNING keystonemiddleware.auth_token [None req-21e23b53-92a7-4cda-9385-ddb69cb3ab56 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 13:37:30.590181 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: WARNING keystonemiddleware.auth_token [None req-7cdd5993-10b0-4135-bfb1-37627f8413d9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 13:37:30.603135 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: WARNING keystonemiddleware.auth_token [None req-7cdd5993-10b0-4135-bfb1-37627f8413d9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 13:37:30.730960 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: WARNING keystonemiddleware.auth_token [None req-21e23b53-92a7-4cda-9385-ddb69cb3ab56 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 13:37:30.737243 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: WARNING keystonemiddleware.auth_token [None req-21e23b53-92a7-4cda-9385-ddb69cb3ab56 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 13:37:30.742846 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561b80abc9c0 pid: 133015 (default app) Aug 24 13:37:31.012722 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: WARNING keystonemiddleware.auth_token [None req-7cdd5993-10b0-4135-bfb1-37627f8413d9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 13:37:31.019013 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: WARNING keystonemiddleware.auth_token [None req-7cdd5993-10b0-4135-bfb1-37627f8413d9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 13:37:31.024742 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x561b80abc9c0 pid: 133014 (default app) Aug 24 13:38:08.441687 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_api:SELECT=3 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:38:08.442885 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=3 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:38:08.443883 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=3 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:38:08.444762 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=3 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:38:10.423580 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a2ab484e-9324-4002-83ae-8457b1af5409 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Action: 'create', calling method: .version_select at 0x7f96c419e8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-243272376"}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:38:11.129330 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_api:SELECT=3 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:38:11.130681 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=3 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:38:11.131908 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=3 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:38:11.133354 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=3 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:38:13.205996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-3003f042-3bda-4c20-9b5e-8712154f11f0 tempest-VolumesGetTestJSON-1430188452 tempest-VolumesGetTestJSON-1430188452-project] Action: 'create', calling method: .version_select at 0x7f96c419f8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1254323274", "metadata": {"Type": "work"}}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:38:15.387945 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a2ab484e-9324-4002-83ae-8457b1af5409 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 6.675977 Aug 24 13:38:15.387945 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 1/1] 10.222.0.73 () {60 vars in 1155 bytes} [Wed Aug 24 13:38:08 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 6699 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 13:38:15.387945 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-675cd77e-3bf6-4476-85c7-8af8f2556134 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Calling method '.version_select at 0x7f96c3ff9700>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:15.677813 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-675cd77e-3bf6-4476-85c7-8af8f2556134 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/8c5d3d9a-d5a9-41cf-a605-d63159e3b3db" status: 200 len: 344 microversion: 2.1 time: 0.545526 Aug 24 13:38:15.679460 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 2/2] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 13:38:15 2022] GET /compute/v2.1/os-volumes/8c5d3d9a-d5a9-41cf-a605-d63159e3b3db => generated 344 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:38:16.662944 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-3003f042-3bda-4c20-9b5e-8712154f11f0 tempest-VolumesGetTestJSON-1430188452 tempest-VolumesGetTestJSON-1430188452-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 5.559628 Aug 24 13:38:16.668337 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 1/3] 10.222.0.73 () {60 vars in 1156 bytes} [Wed Aug 24 13:38:11 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 5568 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 13:38:16.693128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-61aa96b9-42ec-49a2-8765-583960db8f86 tempest-VolumesGetTestJSON-1430188452 tempest-VolumesGetTestJSON-1430188452-project] Calling method '.version_select at 0x7f96c3ff9dc0>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:16.699074 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-aa36aa20-ec04-452e-838a-9764f9071203 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Calling method '.version_select at 0x7f96c3ff8700>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:16.898256 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-61aa96b9-42ec-49a2-8765-583960db8f86 tempest-VolumesGetTestJSON-1430188452 tempest-VolumesGetTestJSON-1430188452-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/3a2ee279-94f1-482f-9a54-3540569d3f6f" status: 200 len: 353 microversion: 2.1 time: 0.218517 Aug 24 13:38:16.900162 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 3/4] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 13:38:16 2022] GET /compute/v2.1/os-volumes/3a2ee279-94f1-482f-9a54-3540569d3f6f => generated 353 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:38:17.004816 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-aa36aa20-ec04-452e-838a-9764f9071203 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/8c5d3d9a-d5a9-41cf-a605-d63159e3b3db" status: 200 len: 345 microversion: 2.1 time: 0.310100 Aug 24 13:38:17.005376 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 2/5] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 13:38:16 2022] GET /compute/v2.1/os-volumes/8c5d3d9a-d5a9-41cf-a605-d63159e3b3db => generated 345 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:38:17.023027 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-cff882b7-4385-445e-b907-7ff41bf623ad tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Action: 'create', calling method: .version_select at 0x7f96c40114c0>, body: {"snapshot": {"volume_id": "8c5d3d9a-d5a9-41cf-a605-d63159e3b3db", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1404829905"}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:38:17.917472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-5e7de2f2-6489-4ba0-8542-701e5152974d tempest-VolumesGetTestJSON-1430188452 tempest-VolumesGetTestJSON-1430188452-project] Calling method '.version_select at 0x7f96c3ff8e50>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:18.077396 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-5e7de2f2-6489-4ba0-8542-701e5152974d tempest-VolumesGetTestJSON-1430188452 tempest-VolumesGetTestJSON-1430188452-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/3a2ee279-94f1-482f-9a54-3540569d3f6f" status: 200 len: 353 microversion: 2.1 time: 0.166995 Aug 24 13:38:18.078133 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 3/6] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 13:38:17 2022] GET /compute/v2.1/os-volumes/3a2ee279-94f1-482f-9a54-3540569d3f6f => generated 353 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:38:18.350143 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-cff882b7-4385-445e-b907-7ff41bf623ad tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] 10.222.0.73 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.335136 Aug 24 13:38:18.351217 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 4/7] 10.222.0.73 () {60 vars in 1162 bytes} [Wed Aug 24 13:38:17 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:38:18.370690 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-61de5a7d-cdf1-4ad4-8276-f05ed5ef1f7c tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Calling method '.version_select at 0x7f96c400c550>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:18.964955 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-61de5a7d-cdf1-4ad4-8276-f05ed5ef1f7c tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/71450fc9-1964-4e26-84c5-4f0459996c33" status: 200 len: 287 microversion: 2.1 time: 0.602209 Aug 24 13:38:18.966201 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 4/8] 10.222.0.73 () {58 vars in 1251 bytes} [Wed Aug 24 13:38:18 2022] GET /compute/v2.1/os-snapshots/71450fc9-1964-4e26-84c5-4f0459996c33 => generated 287 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:38:18.983624 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-41f4b6e5-fa67-4815-887a-a7260ed8142f tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Calling method '.version_select at 0x7f96c4011e50>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:19.093476 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-f94b5982-41c0-4d8c-8ec5-874d3806e6f8 tempest-VolumesGetTestJSON-1430188452 tempest-VolumesGetTestJSON-1430188452-project] Calling method '.version_select at 0x7f96c3ff8ca0>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:19.106624 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-41f4b6e5-fa67-4815-887a-a7260ed8142f tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.130423 Aug 24 13:38:19.115412 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 5/9] 10.222.0.73 () {58 vars in 1140 bytes} [Wed Aug 24 13:38:18 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:38:19.122240 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-940db93c-60a3-4b34-a22d-f0ba6c47fb02 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Calling method '.version_select at 0x7f96c3ff9820>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:19.173890 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-940db93c-60a3-4b34-a22d-f0ba6c47fb02 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/71450fc9-1964-4e26-84c5-4f0459996c33" status: 200 len: 287 microversion: 2.1 time: 0.056713 Aug 24 13:38:19.179984 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 6/10] 10.222.0.73 () {58 vars in 1251 bytes} [Wed Aug 24 13:38:19 2022] GET /compute/v2.1/os-snapshots/71450fc9-1964-4e26-84c5-4f0459996c33 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:38:19.225499 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-f94b5982-41c0-4d8c-8ec5-874d3806e6f8 tempest-VolumesGetTestJSON-1430188452 tempest-VolumesGetTestJSON-1430188452-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/3a2ee279-94f1-482f-9a54-3540569d3f6f" status: 200 len: 354 microversion: 2.1 time: 0.135276 Aug 24 13:38:19.236078 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 5/11] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 13:38:19 2022] GET /compute/v2.1/os-volumes/3a2ee279-94f1-482f-9a54-3540569d3f6f => generated 354 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:38:19.253283 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-380b2f18-d95c-48fb-a10d-50842d5082f0 tempest-VolumesGetTestJSON-1430188452 tempest-VolumesGetTestJSON-1430188452-project] Calling method '.version_select at 0x7f96c4019040>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:19.334876 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-380b2f18-d95c-48fb-a10d-50842d5082f0 tempest-VolumesGetTestJSON-1430188452 tempest-VolumesGetTestJSON-1430188452-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/3a2ee279-94f1-482f-9a54-3540569d3f6f" status: 200 len: 354 microversion: 2.1 time: 0.097689 Aug 24 13:38:19.336165 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 7/12] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 13:38:19 2022] GET /compute/v2.1/os-volumes/3a2ee279-94f1-482f-9a54-3540569d3f6f => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:38:19.363893 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-784fe4ae-4676-46d8-9266-593187e5d0b8 tempest-VolumesGetTestJSON-1430188452 tempest-VolumesGetTestJSON-1430188452-project] Calling method '.version_select at 0x7f96c419fee0>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:19.700072 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-784fe4ae-4676-46d8-9266-593187e5d0b8 tempest-VolumesGetTestJSON-1430188452 tempest-VolumesGetTestJSON-1430188452-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/3a2ee279-94f1-482f-9a54-3540569d3f6f" status: 202 len: 0 microversion: 2.1 time: 0.342061 Aug 24 13:38:19.712258 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 6/13] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 13:38:19 2022] DELETE /compute/v2.1/os-volumes/3a2ee279-94f1-482f-9a54-3540569d3f6f => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 13:38:19.741780 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-32d7151d-c21d-41a4-8c32-2fed347dfd03 tempest-VolumesGetTestJSON-1430188452 tempest-VolumesGetTestJSON-1430188452-project] Calling method '.version_select at 0x7f96c3ff98b0>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:19.879610 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-32d7151d-c21d-41a4-8c32-2fed347dfd03 tempest-VolumesGetTestJSON-1430188452 tempest-VolumesGetTestJSON-1430188452-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/3a2ee279-94f1-482f-9a54-3540569d3f6f" status: 200 len: 353 microversion: 2.1 time: 0.162080 Aug 24 13:38:19.882225 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 8/14] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 13:38:19 2022] GET /compute/v2.1/os-volumes/3a2ee279-94f1-482f-9a54-3540569d3f6f => generated 353 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:38:20.187714 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-6cbf3c15-dab7-4163-a16a-3f2bc382b5e0 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Calling method '.version_select at 0x7f96c400c3a0>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:20.256444 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-6cbf3c15-dab7-4163-a16a-3f2bc382b5e0 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/71450fc9-1964-4e26-84c5-4f0459996c33" status: 200 len: 287 microversion: 2.1 time: 0.073090 Aug 24 13:38:20.257469 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 7/15] 10.222.0.73 () {58 vars in 1251 bytes} [Wed Aug 24 13:38:20 2022] GET /compute/v2.1/os-snapshots/71450fc9-1964-4e26-84c5-4f0459996c33 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:38:20.904745 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-fab37ca8-e3aa-4144-b25e-89b66ee8316e tempest-VolumesGetTestJSON-1430188452 tempest-VolumesGetTestJSON-1430188452-project] Calling method '.version_select at 0x7f96c3ff9dc0>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:21.073869 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-fab37ca8-e3aa-4144-b25e-89b66ee8316e tempest-VolumesGetTestJSON-1430188452 tempest-VolumesGetTestJSON-1430188452-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/3a2ee279-94f1-482f-9a54-3540569d3f6f" status: 200 len: 353 microversion: 2.1 time: 0.177170 Aug 24 13:38:21.082785 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 9/16] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 13:38:20 2022] GET /compute/v2.1/os-volumes/3a2ee279-94f1-482f-9a54-3540569d3f6f => generated 353 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:38:21.274588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-f34700ed-b73b-4ae2-9c8c-0da3d4166659 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Calling method '.version_select at 0x7f96c3ff8670>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:21.354625 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-f34700ed-b73b-4ae2-9c8c-0da3d4166659 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/71450fc9-1964-4e26-84c5-4f0459996c33" status: 200 len: 287 microversion: 2.1 time: 0.086899 Aug 24 13:38:21.356237 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 8/17] 10.222.0.73 () {58 vars in 1251 bytes} [Wed Aug 24 13:38:21 2022] GET /compute/v2.1/os-snapshots/71450fc9-1964-4e26-84c5-4f0459996c33 => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:38:22.089759 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-0585c512-7f55-4a5d-b4ac-e3be6b76bc4b tempest-VolumesGetTestJSON-1430188452 tempest-VolumesGetTestJSON-1430188452-project] Calling method '.version_select at 0x7f96c4011310>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:22.194451 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-0585c512-7f55-4a5d-b4ac-e3be6b76bc4b tempest-VolumesGetTestJSON-1430188452 tempest-VolumesGetTestJSON-1430188452-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/3a2ee279-94f1-482f-9a54-3540569d3f6f" status: 200 len: 353 microversion: 2.1 time: 0.108775 Aug 24 13:38:22.195314 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 10/18] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 13:38:22 2022] GET /compute/v2.1/os-volumes/3a2ee279-94f1-482f-9a54-3540569d3f6f => generated 353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:38:22.369774 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-b7185b7b-3c03-4782-9b88-4a1cab7a2c70 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Calling method '.version_select at 0x7f96c3ff8dc0>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:22.505823 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-b7185b7b-3c03-4782-9b88-4a1cab7a2c70 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/71450fc9-1964-4e26-84c5-4f0459996c33" status: 200 len: 288 microversion: 2.1 time: 0.140070 Aug 24 13:38:22.507509 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 9/19] 10.222.0.73 () {58 vars in 1251 bytes} [Wed Aug 24 13:38:22 2022] GET /compute/v2.1/os-snapshots/71450fc9-1964-4e26-84c5-4f0459996c33 => generated 288 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:38:22.520975 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-09be1755-e6b5-4290-80f2-f3fb919f6aee tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Calling method '.version_select at 0x7f96c4011e50>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:22.761162 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-09be1755-e6b5-4290-80f2-f3fb919f6aee tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] 10.222.0.73 "DELETE /compute/v2.1/os-snapshots/71450fc9-1964-4e26-84c5-4f0459996c33" status: 202 len: 0 microversion: 2.1 time: 0.245737 Aug 24 13:38:22.761740 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 11/20] 10.222.0.73 () {58 vars in 1254 bytes} [Wed Aug 24 13:38:22 2022] DELETE /compute/v2.1/os-snapshots/71450fc9-1964-4e26-84c5-4f0459996c33 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:38:22.771275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-da6d7561-ed87-4e74-a0d8-f72d92821b32 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Calling method '.version_select at 0x7f96c400c280>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:22.825475 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-da6d7561-ed87-4e74-a0d8-f72d92821b32 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/71450fc9-1964-4e26-84c5-4f0459996c33" status: 200 len: 287 microversion: 2.1 time: 0.059058 Aug 24 13:38:22.826178 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 10/21] 10.222.0.73 () {58 vars in 1251 bytes} [Wed Aug 24 13:38:22 2022] GET /compute/v2.1/os-snapshots/71450fc9-1964-4e26-84c5-4f0459996c33 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:38:23.215869 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d8b151bb-0b2b-4303-ab08-aa705e8b1b57 tempest-VolumesGetTestJSON-1430188452 tempest-VolumesGetTestJSON-1430188452-project] Calling method '.version_select at 0x7f96c4011b80>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:23.280554 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.wsgi [None req-d8b151bb-0b2b-4303-ab08-aa705e8b1b57 tempest-VolumesGetTestJSON-1430188452 tempest-VolumesGetTestJSON-1430188452-project] HTTP exception thrown: Volume 3a2ee279-94f1-482f-9a54-3540569d3f6f could not be found. Aug 24 13:38:23.293760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d8b151bb-0b2b-4303-ab08-aa705e8b1b57 tempest-VolumesGetTestJSON-1430188452 tempest-VolumesGetTestJSON-1430188452-project] Request method failure captured: Aug 24 13:38:23.293760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: GET /compute/v2.1/os-volumes/3a2ee279-94f1-482f-9a54-3540569d3f6f HTTP/1.1 Aug 24 13:38:23.293760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:38:23.293760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:38:23.293760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:38:23.293760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 0 Aug 24 13:38:23.293760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:38:23.293760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:38:23.293760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:38:23.293760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:38:23.293760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBinDAe5HE0XNKufaSpEneR7_P1jLKJdUH-RlsF6AqwDgGsE_6TPIAQ19im_xDVZ5xPOrRO8AYuHDs2JgTPbszIJLLauk12Q2p_iQYpYtKOqnyqg2K6wX5KZac-JV3Q5AugAAQGqBKAA247uXdpTNc1BttP4SDTixvfWpDTraNJjObCU Aug 24 13:38:23.293760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:38:23.293760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:38:23.293760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:38:23.293760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:38:23.293760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:38:23.293760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:38:23.293760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: 6be8ac36241e4131b3846cd43f01a3b4 Aug 24 13:38:23.293760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-VolumesGetTestJSON-1430188452 Aug 24 13:38:23.293760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:38:23.293760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:38:23.294940 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6be8ac36241e4131b3846cd43f01a3b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6be8ac36241e4131b3846cd43f01a3b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6be8ac36241e4131b3846cd43f01a3b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6be8ac36241e4131b3846cd43f01a3b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:38:23.294940 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-VolumesGetTestJSON-1430188452 Aug 24 13:38:23.294940 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: 6be8ac36241e4131b3846cd43f01a3b4 Aug 24 13:38:23.294940 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-VolumesGetTestJSON-1430188452 Aug 24 13:38:23.294940 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-VolumesGetTestJSON-1430188452-project Aug 24 13:38:23.294940 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:38:23.294940 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:38:23.294940 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: f924d125ffa245d1a34ccdc160c7b86b Aug 24 13:38:23.294940 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-VolumesGetTestJSON-1430188452-project Aug 24 13:38:23.294940 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: Aug 24 13:38:23.294940 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Volume 3a2ee279-94f1-482f-9a54-3540569d3f6f could not be found. Aug 24 13:38:23.294940 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'id': '3a2ee279-94f1-482f-9a54-3540569d3f6f'} Aug 24 13:38:23.294940 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:38:23.295614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:38:23.295614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 13:38:23.295614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 13:38:23.295614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 13:38:23.295614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 13:38:23.295614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 13:38:23.295614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 13:38:23.295614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 13:38:23.295614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 13:38:23.295614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 13:38:23.295614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 13:38:23.295614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 13:38:23.295614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 13:38:23.295614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 13:38:23.295614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 13:38:23.295614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a2ee279-94f1-482f-9a54-3540569d3f6f could not be found. (HTTP 404) (Request-ID: req-78ca3ffb-d3f9-45c6-b7af-794707a80397) Aug 24 13:38:23.295614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:38:23.295614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:38:23.295614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:38:23.296572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:38:23.296572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 13:38:23.296572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 13:38:23.296572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 13:38:23.296572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 13:38:23.296572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 13:38:23.296572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 13:38:23.296572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 13:38:23.296572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 13:38:23.296572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 13:38:23.296572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 13:38:23.296572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 13:38:23.296572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 13:38:23.296572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 13:38:23.296572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 13:38:23.296572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 13:38:23.296572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 13:38:23.296572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 13:38:23.296572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 13:38:23.297586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 13:38:23.297586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 13:38:23.297586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 13:38:23.297586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 13:38:23.297586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a2ee279-94f1-482f-9a54-3540569d3f6f could not be found. Aug 24 13:38:23.297586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:38:23.297586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:38:23.297586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:38:23.297586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:38:23.297586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:38:23.297586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:38:23.297586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:38:23.297586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:38:23.297586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 13:38:23.297586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 13:38:23.297586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:38:23.297586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:38:23.297586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 13:38:23.297586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:38:23.298876 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a2ee279-94f1-482f-9a54-3540569d3f6f could not be found. Aug 24 13:38:23.298876 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:38:23.298876 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:38:23.298876 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:38:23.298876 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:38:23.298876 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:38:23.298876 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:38:23.298876 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:38:23.298876 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:38:23.298876 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a2ee279-94f1-482f-9a54-3540569d3f6f could not be found. Aug 24 13:38:23.298876 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:38:23.302493 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d8b151bb-0b2b-4303-ab08-aa705e8b1b57 tempest-VolumesGetTestJSON-1430188452 tempest-VolumesGetTestJSON-1430188452-project] Returning 404 to user: Volume 3a2ee279-94f1-482f-9a54-3540569d3f6f could not be found. {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:38:23.303664 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-d8b151bb-0b2b-4303-ab08-aa705e8b1b57 tempest-VolumesGetTestJSON-1430188452 tempest-VolumesGetTestJSON-1430188452-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/3a2ee279-94f1-482f-9a54-3540569d3f6f" status: 404 len: 109 microversion: 2.1 time: 0.093727 Aug 24 13:38:23.304456 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 12/22] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 13:38:23 2022] GET /compute/v2.1/os-volumes/3a2ee279-94f1-482f-9a54-3540569d3f6f => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:38:23.839017 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-f4669072-12d1-48a0-a9fa-3f7ff8b89665 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Calling method '.version_select at 0x7f96c400cd30>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:23.939334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-f4669072-12d1-48a0-a9fa-3f7ff8b89665 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] HTTP exception thrown: Snapshot 71450fc9-1964-4e26-84c5-4f0459996c33 could not be found. Aug 24 13:38:23.939334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-f4669072-12d1-48a0-a9fa-3f7ff8b89665 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Request method failure captured: Aug 24 13:38:23.939334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: GET /compute/v2.1/os-snapshots/71450fc9-1964-4e26-84c5-4f0459996c33 HTTP/1.1 Aug 24 13:38:23.939334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:38:23.939334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:38:23.939334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:38:23.939334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:38:23.939334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:38:23.939334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:38:23.939334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:38:23.939334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:38:23.939334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBinA7dKFEHvJ_S6a2HpPtQ6vugYnsc56nAWwwFu2w62ltXlaFlAg6Na0YiFFwDAEMHYw4OfIvCgztpI0VVzhnbAVdhvXanmVV415P38J-kNx6MV_KWumXLoa0MJyFYmYmDRk3PWfqnuNjkvrduVStJsuhj4swzftYi1D469yAHhM7gE Aug 24 13:38:23.939334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:38:23.939334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:38:23.939334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:38:23.939334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:38:23.939334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:38:23.939334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:38:23.939334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 867d7c32e6b545f49079bfcb6886db3a Aug 24 13:38:23.939334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2108532705 Aug 24 13:38:23.939334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:38:23.939334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:38:23.942120 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/867d7c32e6b545f49079bfcb6886db3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/867d7c32e6b545f49079bfcb6886db3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_867d7c32e6b545f49079bfcb6886db3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/867d7c32e6b545f49079bfcb6886db3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:38:23.942120 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2108532705 Aug 24 13:38:23.942120 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 867d7c32e6b545f49079bfcb6886db3a Aug 24 13:38:23.942120 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2108532705 Aug 24 13:38:23.942120 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-VolumesSnapshotsTestJSON-2108532705-project Aug 24 13:38:23.942120 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:38:23.942120 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:38:23.942120 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: fce6a5fc556c4cec9fbe79960cce25ae Aug 24 13:38:23.942120 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2108532705-project Aug 24 13:38:23.942120 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: Aug 24 13:38:23.942120 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Snapshot 71450fc9-1964-4e26-84c5-4f0459996c33 could not be found. Aug 24 13:38:23.942120 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': '71450fc9-1964-4e26-84c5-4f0459996c33'} Aug 24 13:38:23.942120 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:38:23.942882 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:38:23.942882 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 13:38:23.942882 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 13:38:23.942882 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 13:38:23.942882 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 13:38:23.942882 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 13:38:23.942882 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 13:38:23.942882 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 13:38:23.942882 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 13:38:23.942882 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 13:38:23.942882 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 13:38:23.942882 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 13:38:23.942882 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 13:38:23.942882 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 13:38:23.942882 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 13:38:23.942882 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 71450fc9-1964-4e26-84c5-4f0459996c33 could not be found. (HTTP 404) (Request-ID: req-ba102356-a2b0-4e58-9f78-eab3e8d2501c) Aug 24 13:38:23.942882 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:38:23.942882 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:38:23.943729 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:38:23.943729 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:38:23.943729 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 13:38:23.943729 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 13:38:23.943729 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 13:38:23.943729 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 13:38:23.943729 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 13:38:23.943729 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 13:38:23.943729 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 13:38:23.943729 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 13:38:23.943729 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 13:38:23.943729 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 13:38:23.943729 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 13:38:23.943729 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 13:38:23.943729 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 13:38:23.943729 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 13:38:23.943729 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 13:38:23.943729 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 13:38:23.943729 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 13:38:23.944766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 13:38:23.944766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 13:38:23.944766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 13:38:23.944766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 13:38:23.944766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 13:38:23.944766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 71450fc9-1964-4e26-84c5-4f0459996c33 could not be found. Aug 24 13:38:23.944766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:38:23.944766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:38:23.944766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:38:23.944766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:38:23.944766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:38:23.944766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:38:23.944766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:38:23.944766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:38:23.944766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 13:38:23.944766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 13:38:23.944766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:38:23.944766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:38:23.944766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 13:38:23.944766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:38:23.945734 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 71450fc9-1964-4e26-84c5-4f0459996c33 could not be found. Aug 24 13:38:23.945734 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:38:23.945734 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:38:23.945734 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:38:23.945734 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:38:23.945734 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:38:23.945734 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:38:23.945734 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:38:23.945734 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:38:23.945734 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 71450fc9-1964-4e26-84c5-4f0459996c33 could not be found. Aug 24 13:38:23.945734 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:38:23.945734 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-f4669072-12d1-48a0-a9fa-3f7ff8b89665 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Returning 404 to user: Snapshot 71450fc9-1964-4e26-84c5-4f0459996c33 could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:38:23.945734 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-f4669072-12d1-48a0-a9fa-3f7ff8b89665 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/71450fc9-1964-4e26-84c5-4f0459996c33" status: 404 len: 111 microversion: 2.1 time: 0.102349 Aug 24 13:38:23.952156 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 11/23] 10.222.0.73 () {58 vars in 1251 bytes} [Wed Aug 24 13:38:23 2022] GET /compute/v2.1/os-snapshots/71450fc9-1964-4e26-84c5-4f0459996c33 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:38:23.960929 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-35e3cee1-b08e-4970-8f1e-8e52c8d69583 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Calling method '.version_select at 0x7f96c49cdca0>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:24.463792 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-35e3cee1-b08e-4970-8f1e-8e52c8d69583 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/8c5d3d9a-d5a9-41cf-a605-d63159e3b3db" status: 202 len: 0 microversion: 2.1 time: 0.510138 Aug 24 13:38:24.466889 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 13/24] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 13:38:23 2022] DELETE /compute/v2.1/os-volumes/8c5d3d9a-d5a9-41cf-a605-d63159e3b3db => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:38:24.479696 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-d426555d-1653-4de3-b65d-2e4058b1990a tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Calling method '.version_select at 0x7f96c3f7a0d0>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:24.626091 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-d426555d-1653-4de3-b65d-2e4058b1990a tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/8c5d3d9a-d5a9-41cf-a605-d63159e3b3db" status: 200 len: 344 microversion: 2.1 time: 0.154462 Aug 24 13:38:24.628765 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 12/25] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 13:38:24 2022] GET /compute/v2.1/os-volumes/8c5d3d9a-d5a9-41cf-a605-d63159e3b3db => generated 344 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:38:25.646584 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-e5797fa7-2aae-44b8-8f45-73848a38c20f tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Calling method '.version_select at 0x7f96c4019160>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:25.788255 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.wsgi [None req-e5797fa7-2aae-44b8-8f45-73848a38c20f tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] HTTP exception thrown: Volume 8c5d3d9a-d5a9-41cf-a605-d63159e3b3db could not be found. Aug 24 13:38:25.789562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-e5797fa7-2aae-44b8-8f45-73848a38c20f tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Request method failure captured: Aug 24 13:38:25.789562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: GET /compute/v2.1/os-volumes/8c5d3d9a-d5a9-41cf-a605-d63159e3b3db HTTP/1.1 Aug 24 13:38:25.789562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:38:25.789562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:38:25.789562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:38:25.789562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 0 Aug 24 13:38:25.789562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:38:25.789562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:38:25.789562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:38:25.789562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:38:25.789562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBinA7dKFEHvJ_S6a2HpPtQ6vugYnsc56nAWwwFu2w62ltXlaFlAg6Na0YiFFwDAEMHYw4OfIvCgztpI0VVzhnbAVdhvXanmVV415P38J-kNx6MV_KWumXLoa0MJyFYmYmDRk3PWfqnuNjkvrduVStJsuhj4swzftYi1D469yAHhM7gE Aug 24 13:38:25.789562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:38:25.789562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:38:25.789562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:38:25.789562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:38:25.789562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:38:25.789562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:38:25.789562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: 867d7c32e6b545f49079bfcb6886db3a Aug 24 13:38:25.789562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2108532705 Aug 24 13:38:25.789562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:38:25.789562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:38:25.790706 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/867d7c32e6b545f49079bfcb6886db3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/867d7c32e6b545f49079bfcb6886db3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_867d7c32e6b545f49079bfcb6886db3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/867d7c32e6b545f49079bfcb6886db3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:38:25.790706 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2108532705 Aug 24 13:38:25.790706 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: 867d7c32e6b545f49079bfcb6886db3a Aug 24 13:38:25.790706 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2108532705 Aug 24 13:38:25.790706 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-VolumesSnapshotsTestJSON-2108532705-project Aug 24 13:38:25.790706 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:38:25.790706 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:38:25.790706 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: fce6a5fc556c4cec9fbe79960cce25ae Aug 24 13:38:25.790706 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2108532705-project Aug 24 13:38:25.790706 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: Aug 24 13:38:25.790706 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Volume 8c5d3d9a-d5a9-41cf-a605-d63159e3b3db could not be found. Aug 24 13:38:25.790706 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'id': '8c5d3d9a-d5a9-41cf-a605-d63159e3b3db'} Aug 24 13:38:25.790706 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:38:25.791357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:38:25.791357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 13:38:25.791357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 13:38:25.791357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 13:38:25.791357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 13:38:25.791357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 13:38:25.791357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 13:38:25.791357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 13:38:25.791357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 13:38:25.791357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 13:38:25.791357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 13:38:25.791357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 13:38:25.791357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 13:38:25.791357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 13:38:25.791357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 13:38:25.791357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c5d3d9a-d5a9-41cf-a605-d63159e3b3db could not be found. (HTTP 404) (Request-ID: req-f2238093-a035-4f6a-a501-4f7255dcf7c2) Aug 24 13:38:25.791357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:38:25.791357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:38:25.791357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:38:25.807213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:38:25.807213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 13:38:25.807213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 13:38:25.807213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 13:38:25.807213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 13:38:25.807213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 13:38:25.807213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 13:38:25.807213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 13:38:25.807213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 13:38:25.807213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 13:38:25.807213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 13:38:25.807213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 13:38:25.807213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 13:38:25.807213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 13:38:25.807213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 13:38:25.807213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 13:38:25.807213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 13:38:25.807213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 13:38:25.807213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 13:38:25.810599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 13:38:25.810599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 13:38:25.810599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 13:38:25.810599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 13:38:25.810599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c5d3d9a-d5a9-41cf-a605-d63159e3b3db could not be found. Aug 24 13:38:25.810599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:38:25.810599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:38:25.810599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:38:25.810599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:38:25.810599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:38:25.810599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:38:25.810599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:38:25.810599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:38:25.810599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 13:38:25.810599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 13:38:25.810599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:38:25.810599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:38:25.810599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 13:38:25.810599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:38:25.815037 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c5d3d9a-d5a9-41cf-a605-d63159e3b3db could not be found. Aug 24 13:38:25.815037 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:38:25.815037 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:38:25.815037 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:38:25.815037 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:38:25.815037 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:38:25.815037 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:38:25.815037 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:38:25.815037 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:38:25.815037 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c5d3d9a-d5a9-41cf-a605-d63159e3b3db could not be found. Aug 24 13:38:25.815037 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:38:25.815037 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-e5797fa7-2aae-44b8-8f45-73848a38c20f tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Returning 404 to user: Volume 8c5d3d9a-d5a9-41cf-a605-d63159e3b3db could not be found. {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:38:25.815037 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-e5797fa7-2aae-44b8-8f45-73848a38c20f tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/8c5d3d9a-d5a9-41cf-a605-d63159e3b3db" status: 404 len: 109 microversion: 2.1 time: 0.151543 Aug 24 13:38:25.815037 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 14/26] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 13:38:25 2022] GET /compute/v2.1/os-volumes/8c5d3d9a-d5a9-41cf-a605-d63159e3b3db => generated 109 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:38:25.817115 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-67ce2184-d167-4dd1-8dd5-2c9d98354353 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Calling method '.version_select at 0x7f96c49cdaf0>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:25.964724 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-67ce2184-d167-4dd1-8dd5-2c9d98354353 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] HTTP exception thrown: Volume 8c5d3d9a-d5a9-41cf-a605-d63159e3b3db could not be found. Aug 24 13:38:25.967650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-67ce2184-d167-4dd1-8dd5-2c9d98354353 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Request method failure captured: Aug 24 13:38:25.967650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: DELETE /compute/v2.1/os-volumes/8c5d3d9a-d5a9-41cf-a605-d63159e3b3db HTTP/1.1 Aug 24 13:38:25.967650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:38:25.967650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:38:25.967650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:38:25.967650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:38:25.967650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:38:25.967650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:38:25.967650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:38:25.967650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:38:25.967650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBinA7dKFEHvJ_S6a2HpPtQ6vugYnsc56nAWwwFu2w62ltXlaFlAg6Na0YiFFwDAEMHYw4OfIvCgztpI0VVzhnbAVdhvXanmVV415P38J-kNx6MV_KWumXLoa0MJyFYmYmDRk3PWfqnuNjkvrduVStJsuhj4swzftYi1D469yAHhM7gE Aug 24 13:38:25.967650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:38:25.967650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:38:25.967650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:38:25.967650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:38:25.967650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:38:25.967650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:38:25.967650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 867d7c32e6b545f49079bfcb6886db3a Aug 24 13:38:25.967650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2108532705 Aug 24 13:38:25.967650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:38:25.967650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:38:25.968700 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/867d7c32e6b545f49079bfcb6886db3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/867d7c32e6b545f49079bfcb6886db3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_867d7c32e6b545f49079bfcb6886db3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/867d7c32e6b545f49079bfcb6886db3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:38:25.968700 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2108532705 Aug 24 13:38:25.968700 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 867d7c32e6b545f49079bfcb6886db3a Aug 24 13:38:25.968700 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2108532705 Aug 24 13:38:25.968700 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-VolumesSnapshotsTestJSON-2108532705-project Aug 24 13:38:25.968700 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:38:25.968700 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:38:25.968700 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: fce6a5fc556c4cec9fbe79960cce25ae Aug 24 13:38:25.968700 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2108532705-project Aug 24 13:38:25.968700 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: Aug 24 13:38:25.968700 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Volume 8c5d3d9a-d5a9-41cf-a605-d63159e3b3db could not be found. Aug 24 13:38:25.968700 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': '8c5d3d9a-d5a9-41cf-a605-d63159e3b3db'} Aug 24 13:38:25.968700 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:38:25.969311 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:38:25.969311 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 13:38:25.969311 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 13:38:25.969311 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 13:38:25.969311 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 13:38:25.969311 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 13:38:25.969311 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 13:38:25.969311 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 13:38:25.969311 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 13:38:25.969311 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 13:38:25.969311 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 13:38:25.969311 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 13:38:25.969311 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 13:38:25.969311 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 13:38:25.969311 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 13:38:25.969311 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c5d3d9a-d5a9-41cf-a605-d63159e3b3db could not be found. (HTTP 404) (Request-ID: req-1117691f-43b6-4198-9dbd-d3d19c531146) Aug 24 13:38:25.969311 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:38:25.969311 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:38:25.969311 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:38:25.975394 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:38:25.975394 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 13:38:25.975394 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 13:38:25.975394 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 13:38:25.975394 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 13:38:25.975394 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 13:38:25.975394 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 13:38:25.975394 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 13:38:25.975394 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 13:38:25.975394 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 13:38:25.975394 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 13:38:25.975394 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 13:38:25.975394 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 13:38:25.975394 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 13:38:25.975394 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 13:38:25.975394 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 13:38:25.975394 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 13:38:25.975394 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 13:38:25.975394 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 13:38:25.977856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 13:38:25.977856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 13:38:25.977856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 13:38:25.977856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 13:38:25.977856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c5d3d9a-d5a9-41cf-a605-d63159e3b3db could not be found. Aug 24 13:38:25.977856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:38:25.977856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:38:25.977856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:38:25.977856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:38:25.977856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:38:25.977856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:38:25.977856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:38:25.977856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:38:25.977856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 13:38:25.977856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 13:38:25.977856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:38:25.977856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:38:25.977856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 13:38:25.977856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:38:25.980097 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c5d3d9a-d5a9-41cf-a605-d63159e3b3db could not be found. Aug 24 13:38:25.980097 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:38:25.980097 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:38:25.980097 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:38:25.980097 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:38:25.980097 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:38:25.980097 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:38:25.980097 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:38:25.980097 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:38:25.980097 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c5d3d9a-d5a9-41cf-a605-d63159e3b3db could not be found. Aug 24 13:38:25.980097 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:38:25.980097 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-67ce2184-d167-4dd1-8dd5-2c9d98354353 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Returning 404 to user: Volume 8c5d3d9a-d5a9-41cf-a605-d63159e3b3db could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:38:25.980097 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-67ce2184-d167-4dd1-8dd5-2c9d98354353 tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/8c5d3d9a-d5a9-41cf-a605-d63159e3b3db" status: 404 len: 109 microversion: 2.1 time: 0.164951 Aug 24 13:38:25.980097 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 13/27] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 13:38:25 2022] DELETE /compute/v2.1/os-volumes/8c5d3d9a-d5a9-41cf-a605-d63159e3b3db => generated 109 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:38:25.981830 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-cce0571c-6f31-4524-987f-1352d6a9272f tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Calling method '.version_select at 0x7f96c4019ee0>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:26.138595 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.wsgi [None req-cce0571c-6f31-4524-987f-1352d6a9272f tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] HTTP exception thrown: Volume 8c5d3d9a-d5a9-41cf-a605-d63159e3b3db could not be found. Aug 24 13:38:26.142494 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-cce0571c-6f31-4524-987f-1352d6a9272f tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Request method failure captured: Aug 24 13:38:26.142494 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: GET /compute/v2.1/os-volumes/8c5d3d9a-d5a9-41cf-a605-d63159e3b3db HTTP/1.1 Aug 24 13:38:26.142494 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:38:26.142494 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:38:26.142494 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:38:26.142494 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 0 Aug 24 13:38:26.142494 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:38:26.142494 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:38:26.142494 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:38:26.142494 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:38:26.142494 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBinA7dKFEHvJ_S6a2HpPtQ6vugYnsc56nAWwwFu2w62ltXlaFlAg6Na0YiFFwDAEMHYw4OfIvCgztpI0VVzhnbAVdhvXanmVV415P38J-kNx6MV_KWumXLoa0MJyFYmYmDRk3PWfqnuNjkvrduVStJsuhj4swzftYi1D469yAHhM7gE Aug 24 13:38:26.142494 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:38:26.142494 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:38:26.142494 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:38:26.142494 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:38:26.142494 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:38:26.142494 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:38:26.142494 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: 867d7c32e6b545f49079bfcb6886db3a Aug 24 13:38:26.142494 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2108532705 Aug 24 13:38:26.142494 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:38:26.142494 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:38:26.144087 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/867d7c32e6b545f49079bfcb6886db3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/867d7c32e6b545f49079bfcb6886db3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_867d7c32e6b545f49079bfcb6886db3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/867d7c32e6b545f49079bfcb6886db3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:38:26.144087 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2108532705 Aug 24 13:38:26.144087 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: 867d7c32e6b545f49079bfcb6886db3a Aug 24 13:38:26.144087 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2108532705 Aug 24 13:38:26.144087 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-VolumesSnapshotsTestJSON-2108532705-project Aug 24 13:38:26.144087 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:38:26.144087 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:38:26.144087 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: fce6a5fc556c4cec9fbe79960cce25ae Aug 24 13:38:26.144087 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2108532705-project Aug 24 13:38:26.144087 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: Aug 24 13:38:26.144087 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Volume 8c5d3d9a-d5a9-41cf-a605-d63159e3b3db could not be found. Aug 24 13:38:26.144087 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'id': '8c5d3d9a-d5a9-41cf-a605-d63159e3b3db'} Aug 24 13:38:26.144087 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:38:26.145176 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:38:26.145176 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 13:38:26.145176 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 13:38:26.145176 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 13:38:26.145176 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 13:38:26.145176 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 13:38:26.145176 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 13:38:26.145176 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 13:38:26.145176 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 13:38:26.145176 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 13:38:26.145176 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 13:38:26.145176 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 13:38:26.145176 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 13:38:26.145176 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 13:38:26.145176 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 13:38:26.145176 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c5d3d9a-d5a9-41cf-a605-d63159e3b3db could not be found. (HTTP 404) (Request-ID: req-76bdd6b5-91de-40a2-a00b-4686d6c9350b) Aug 24 13:38:26.145176 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:38:26.145176 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:38:26.145176 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:38:26.146529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:38:26.146529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 13:38:26.146529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 13:38:26.146529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 13:38:26.146529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 13:38:26.146529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 13:38:26.146529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 13:38:26.146529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 13:38:26.146529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 13:38:26.146529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 13:38:26.146529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 13:38:26.146529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 13:38:26.146529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 13:38:26.146529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 13:38:26.146529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 13:38:26.146529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 13:38:26.146529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 13:38:26.146529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 13:38:26.146529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 13:38:26.153794 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 13:38:26.153794 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 13:38:26.153794 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 13:38:26.153794 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 13:38:26.153794 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c5d3d9a-d5a9-41cf-a605-d63159e3b3db could not be found. Aug 24 13:38:26.153794 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:38:26.153794 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:38:26.153794 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:38:26.153794 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:38:26.153794 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:38:26.153794 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:38:26.153794 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:38:26.153794 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:38:26.153794 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 13:38:26.153794 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 13:38:26.153794 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:38:26.153794 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:38:26.153794 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 13:38:26.153794 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:38:26.155357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c5d3d9a-d5a9-41cf-a605-d63159e3b3db could not be found. Aug 24 13:38:26.155357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:38:26.155357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:38:26.155357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:38:26.155357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:38:26.155357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:38:26.155357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:38:26.155357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:38:26.155357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:38:26.155357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c5d3d9a-d5a9-41cf-a605-d63159e3b3db could not be found. Aug 24 13:38:26.155357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:38:26.155357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-cce0571c-6f31-4524-987f-1352d6a9272f tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] Returning 404 to user: Volume 8c5d3d9a-d5a9-41cf-a605-d63159e3b3db could not be found. {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:38:26.155357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-cce0571c-6f31-4524-987f-1352d6a9272f tempest-VolumesSnapshotsTestJSON-2108532705 tempest-VolumesSnapshotsTestJSON-2108532705-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/8c5d3d9a-d5a9-41cf-a605-d63159e3b3db" status: 404 len: 109 microversion: 2.1 time: 0.174276 Aug 24 13:38:26.155357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 15/28] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 13:38:25 2022] GET /compute/v2.1/os-volumes/8c5d3d9a-d5a9-41cf-a605-d63159e3b3db => generated 109 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:38:29.363658 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-4b063588-5737-4faa-852f-61174378fb88 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-861293938", "imageRef": "c520113c-3dae-4490-98bb-19fe3a46b66d", "flavorRef": "452", "networks": [{"uuid": "2e903fbc-329f-4ab0-8009-8377c36a9d55"}]}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:38:29.690509 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.network.neutron [None req-4b063588-5737-4faa-852f-61174378fb88 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] validate_networks() for [('2e903fbc-329f-4ab0-8009-8377c36a9d55', None, None, None, None, None)] {{(pid=133014) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:38:31.239900 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-751c178a-0665-44b9-b8da-4ff9ac3dc468 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Action: 'create', calling method: .version_select at 0x7f96c40191f0>, body: {"keypair": {"name": "tempest-keypair-1682784562", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5JJQLfwdcdodC41IxLwNmsMA9WcJZSxddofCjRy6UCVJsMJdYv07SYrpf/IK0pKy1D2wMIvzIW6b41ZM1a6Xsj16qY93XNdwq3Lmq7RM9j9MBS7vi7Io6Slwgda1geCw=="}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:38:31.330804 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-751c178a-0665-44b9-b8da-4ff9ac3dc468 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Getting quotas for project 4a3794670e8d4c9985547d557d6969e0. Resources: {'key_pairs'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:38:31.349659 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-751c178a-0665-44b9-b8da-4ff9ac3dc468 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Getting quotas for user 773dc87736034257b3d1ae2e8f02bf23 and project 4a3794670e8d4c9985547d557d6969e0. Resources: {'key_pairs'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:38:31.514392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-751c178a-0665-44b9-b8da-4ff9ac3dc468 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.000579 Aug 24 13:38:31.529227 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 16/29] 10.222.0.73 () {62 vars in 1200 bytes} [Wed Aug 24 13:38:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1009 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 13:38:32.285740 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-3003d4f0-1a2e-4b36-9586-c6fec13b5caf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Action: 'create', calling method: .version_select at 0x7f96c3f51790>, body: {"keypair": {"name": "tempest-keypair-124981872", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaHMEAOjpkIXc2VSUi+gwF1XaO3MN8MZcZzVYM2AjLR+KLHXumncSu3sYLPXf5ywqaqtk/Sup7jrjejsAvllehNVLxNeDmwBWhejrkPWLyk+gLuffouVtviCj9uVWsBsQ=="}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:38:32.354702 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-3003d4f0-1a2e-4b36-9586-c6fec13b5caf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Getting quotas for project 019b2e8bdb934d94a25fe4b355e73c68. Resources: {'key_pairs'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:38:32.365757 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-3003d4f0-1a2e-4b36-9586-c6fec13b5caf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Getting quotas for user ea9d4eafe59c4c8180eece8ec9283e40 and project 019b2e8bdb934d94a25fe4b355e73c68. Resources: {'key_pairs'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:38:32.589066 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-3003d4f0-1a2e-4b36-9586-c6fec13b5caf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.065670 Aug 24 13:38:32.591316 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 17/30] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 13:38:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:38:33.570450 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-4b063588-5737-4faa-852f-61174378fb88 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Flavor limits 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:38:33.571647 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-4b063588-5737-4faa-852f-61174378fb88 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Image limits 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:38:33.572538 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-4b063588-5737-4faa-852f-61174378fb88 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Flavor pref 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:38:33.573216 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-4b063588-5737-4faa-852f-61174378fb88 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Image pref 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:38:33.574271 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-4b063588-5737-4faa-852f-61174378fb88 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:38:33.613862 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4b063588-5737-4faa-852f-61174378fb88 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:33.614891 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4b063588-5737-4faa-852f-61174378fb88 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:33.615622 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4b063588-5737-4faa-852f-61174378fb88 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:33.617484 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4b063588-5737-4faa-852f-61174378fb88 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:33.618408 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4b063588-5737-4faa-852f-61174378fb88 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:33.619634 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4b063588-5737-4faa-852f-61174378fb88 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:33.685443 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-4b063588-5737-4faa-852f-61174378fb88 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Getting quotas for project 77b5eebd2706440badffd858826d5c79. Resources: {'instances', 'cores', 'ram'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:38:33.694403 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-4b063588-5737-4faa-852f-61174378fb88 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Getting quotas for user 0108005591b14c5081d460f5c1a7526f and project 77b5eebd2706440badffd858826d5c79. Resources: {'instances', 'cores', 'ram'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:38:33.714043 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-4b063588-5737-4faa-852f-61174378fb88 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Going to run 1 instances... {{(pid=133014) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 13:38:33.720038 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-4b063588-5737-4faa-852f-61174378fb88 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c520113c-3dae-4490-98bb-19fe3a46b66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133014) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 13:38:34.106622 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-4b063588-5737-4faa-852f-61174378fb88 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.878537 Aug 24 13:38:34.134704 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 14/31] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 13:38:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 5903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 13:38:34.182236 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-2cd09bdc-0bc5-4288-ad3a-2a6811895405 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:34.206477 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-2cd09bdc-0bc5-4288-ad3a-2a6811895405 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:34.653520 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2cd09bdc-0bc5-4288-ad3a-2a6811895405 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:34.738099 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-2cd09bdc-0bc5-4288-ad3a-2a6811895405 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1214 microversion: 2.1 time: 0.601692 Aug 24 13:38:34.756389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 18/32] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:34 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1214 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:35.789387 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-51481846-3118-40cc-afa8-c18d37a4966f tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:35.794587 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-51481846-3118-40cc-afa8-c18d37a4966f tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:36.200483 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-51481846-3118-40cc-afa8-c18d37a4966f tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:36.293592 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-51481846-3118-40cc-afa8-c18d37a4966f tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1214 microversion: 2.1 time: 0.516899 Aug 24 13:38:36.299167 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 15/33] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:35 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1214 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:37.326061 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-c9a10d40-a387-4c12-a164-e9d2020b0116 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:37.327597 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-c9a10d40-a387-4c12-a164-e9d2020b0116 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:37.552969 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c9a10d40-a387-4c12-a164-e9d2020b0116 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:37.564160 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-c9a10d40-a387-4c12-a164-e9d2020b0116 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1214 microversion: 2.1 time: 0.242952 Aug 24 13:38:37.573166 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 19/34] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:37 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1214 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:38.268434 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-81ce8982-2a84-4785-8736-7defe37c8023 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1840741788", "imageRef": "c520113c-3dae-4490-98bb-19fe3a46b66d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "385fd5c5-6c70-4a95-9981-8683550b730c"}], "security_groups": [{"name": "tempest-securitygroup--1825755339"}], "key_name": "tempest-keypair-1682784562", "user_data": "}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:38:38.414189 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-9fc1c7b3-01ca-4fa5-b74a-6ed15cdad669 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1135715922", "imageRef": "c520113c-3dae-4490-98bb-19fe3a46b66d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "789a27f6-7f62-4022-86ef-1042c82fc322"}], "security_groups": [{"name": "tempest-securitygroup--728549319"}], "key_name": "tempest-keypair-124981872", "user_data": "}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:38:38.511967 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.network.neutron [None req-81ce8982-2a84-4785-8736-7defe37c8023 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] validate_networks() for [('385fd5c5-6c70-4a95-9981-8683550b730c', None, None, None, None, None)] {{(pid=133014) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:38:38.799777 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.network.neutron [None req-9fc1c7b3-01ca-4fa5-b74a-6ed15cdad669 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] validate_networks() for [('789a27f6-7f62-4022-86ef-1042c82fc322', None, None, None, None, None)] {{(pid=133015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:38:39.929590 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-81ce8982-2a84-4785-8736-7defe37c8023 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Flavor limits 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:38:39.930222 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-81ce8982-2a84-4785-8736-7defe37c8023 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Image limits 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:38:39.931121 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-81ce8982-2a84-4785-8736-7defe37c8023 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Flavor pref 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:38:39.931886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-81ce8982-2a84-4785-8736-7defe37c8023 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Image pref 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:38:39.933206 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-81ce8982-2a84-4785-8736-7defe37c8023 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:38:39.954229 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-81ce8982-2a84-4785-8736-7defe37c8023 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:39.954229 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-81ce8982-2a84-4785-8736-7defe37c8023 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:39.954229 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-81ce8982-2a84-4785-8736-7defe37c8023 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:39.954229 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-81ce8982-2a84-4785-8736-7defe37c8023 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:39.954849 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-81ce8982-2a84-4785-8736-7defe37c8023 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:39.954849 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-81ce8982-2a84-4785-8736-7defe37c8023 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:39.974564 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-81ce8982-2a84-4785-8736-7defe37c8023 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Getting quotas for project 4a3794670e8d4c9985547d557d6969e0. Resources: {'instances', 'cores', 'ram'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:38:39.979093 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-81ce8982-2a84-4785-8736-7defe37c8023 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Getting quotas for user 773dc87736034257b3d1ae2e8f02bf23 and project 4a3794670e8d4c9985547d557d6969e0. Resources: {'instances', 'cores', 'ram'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:38:39.999154 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-81ce8982-2a84-4785-8736-7defe37c8023 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Going to run 1 instances... {{(pid=133014) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 13:38:40.002842 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-81ce8982-2a84-4785-8736-7defe37c8023 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c520113c-3dae-4490-98bb-19fe3a46b66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133014) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 13:38:40.135614 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-81ce8982-2a84-4785-8736-7defe37c8023 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.872530 Aug 24 13:38:40.137326 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 16/35] 10.222.0.73 () {62 vars in 1188 bytes} [Wed Aug 24 13:38:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 1874 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 13:38:40.143098 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-888bcd75-5cb5-43b0-a89a-1c61c014d7c5 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:40.144809 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-888bcd75-5cb5-43b0-a89a-1c61c014d7c5 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:40.152420 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-888bcd75-5cb5-43b0-a89a-1c61c014d7c5 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:40.153172 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-888bcd75-5cb5-43b0-a89a-1c61c014d7c5 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:40.153770 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-888bcd75-5cb5-43b0-a89a-1c61c014d7c5 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:40.155559 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-888bcd75-5cb5-43b0-a89a-1c61c014d7c5 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:40.156203 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-888bcd75-5cb5-43b0-a89a-1c61c014d7c5 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:40.157007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-888bcd75-5cb5-43b0-a89a-1c61c014d7c5 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:40.315121 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-9fc1c7b3-01ca-4fa5-b74a-6ed15cdad669 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Flavor limits 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:38:40.315942 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-9fc1c7b3-01ca-4fa5-b74a-6ed15cdad669 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Image limits 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:38:40.317248 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-9fc1c7b3-01ca-4fa5-b74a-6ed15cdad669 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Flavor pref 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:38:40.318171 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-9fc1c7b3-01ca-4fa5-b74a-6ed15cdad669 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Image pref 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:38:40.319248 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-9fc1c7b3-01ca-4fa5-b74a-6ed15cdad669 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:38:40.347294 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9fc1c7b3-01ca-4fa5-b74a-6ed15cdad669 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:40.348056 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9fc1c7b3-01ca-4fa5-b74a-6ed15cdad669 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:40.348789 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9fc1c7b3-01ca-4fa5-b74a-6ed15cdad669 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:40.349820 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9fc1c7b3-01ca-4fa5-b74a-6ed15cdad669 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:40.350523 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9fc1c7b3-01ca-4fa5-b74a-6ed15cdad669 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:40.352087 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9fc1c7b3-01ca-4fa5-b74a-6ed15cdad669 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:40.370704 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-888bcd75-5cb5-43b0-a89a-1c61c014d7c5 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:40.399961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-888bcd75-5cb5-43b0-a89a-1c61c014d7c5 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1218 microversion: 2.1 time: 0.260649 Aug 24 13:38:40.409921 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-9fc1c7b3-01ca-4fa5-b74a-6ed15cdad669 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Getting quotas for project 019b2e8bdb934d94a25fe4b355e73c68. Resources: {'instances', 'cores', 'ram'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:38:40.410853 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 17/36] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:40 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1218 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:40.419056 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-9fc1c7b3-01ca-4fa5-b74a-6ed15cdad669 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Getting quotas for user ea9d4eafe59c4c8180eece8ec9283e40 and project 019b2e8bdb934d94a25fe4b355e73c68. Resources: {'instances', 'cores', 'ram'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:38:40.427471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-bbadf0ee-fb46-4f1e-9d37-13d358b2c86b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:40.429542 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-bbadf0ee-fb46-4f1e-9d37-13d358b2c86b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:40.448435 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-9fc1c7b3-01ca-4fa5-b74a-6ed15cdad669 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Going to run 1 instances... {{(pid=133015) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 13:38:40.454543 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-9fc1c7b3-01ca-4fa5-b74a-6ed15cdad669 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c520113c-3dae-4490-98bb-19fe3a46b66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 13:38:40.652245 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-bbadf0ee-fb46-4f1e-9d37-13d358b2c86b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:40.686510 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-bbadf0ee-fb46-4f1e-9d37-13d358b2c86b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:40.690936 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-bbadf0ee-fb46-4f1e-9d37-13d358b2c86b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:40.693780 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-bbadf0ee-fb46-4f1e-9d37-13d358b2c86b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1282 microversion: 2.20 time: 0.281180 Aug 24 13:38:40.696037 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 18/37] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:38:40 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1282 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:38:40.709730 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-ad3999e1-e668-486d-8b71-383cd0594c91 tempest-VolumesTestJSON-778787871 tempest-VolumesTestJSON-778787871-project] Calling method '.version_select at 0x7f96c2e5e040>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:40.840651 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-9fc1c7b3-01ca-4fa5-b74a-6ed15cdad669 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.432566 Aug 24 13:38:40.842753 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 20/38] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 13:38:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 2436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 13:38:40.872341 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-9dfaee46-e46e-49f7-a270-32eeb68f0f05 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:40.876905 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-9dfaee46-e46e-49f7-a270-32eeb68f0f05 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:41.065092 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-9dfaee46-e46e-49f7-a270-32eeb68f0f05 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:41.078409 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-9dfaee46-e46e-49f7-a270-32eeb68f0f05 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1241 microversion: 2.1 time: 0.221129 Aug 24 13:38:41.080282 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 21/39] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:40 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1241 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:41.447874 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-2f93d4b1-f80c-4f07-abbd-c274f4b26e18 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:41.449026 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-2f93d4b1-f80c-4f07-abbd-c274f4b26e18 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:41.457853 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f93d4b1-f80c-4f07-abbd-c274f4b26e18 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:41.458362 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f93d4b1-f80c-4f07-abbd-c274f4b26e18 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:41.458873 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f93d4b1-f80c-4f07-abbd-c274f4b26e18 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:41.462174 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f93d4b1-f80c-4f07-abbd-c274f4b26e18 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:41.462668 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f93d4b1-f80c-4f07-abbd-c274f4b26e18 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:41.463142 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f93d4b1-f80c-4f07-abbd-c274f4b26e18 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:41.564243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-ad3999e1-e668-486d-8b71-383cd0594c91 tempest-VolumesTestJSON-778787871 tempest-VolumesTestJSON-778787871-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/750a277e-ef74-4ba9-9d16-302e07e17080" status: 200 len: 351 microversion: 2.1 time: 0.865086 Aug 24 13:38:41.568955 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 19/40] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 13:38:40 2022] GET /compute/v2.1/os-volumes/750a277e-ef74-4ba9-9d16-302e07e17080 => generated 351 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:38:41.681052 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2f93d4b1-f80c-4f07-abbd-c274f4b26e18 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:41.722806 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-48564630-1726-4b6e-aff4-c4fe2232ffc5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:41.724106 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-48564630-1726-4b6e-aff4-c4fe2232ffc5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:41.737234 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-2f93d4b1-f80c-4f07-abbd-c274f4b26e18 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1210 microversion: 2.1 time: 0.287889 Aug 24 13:38:41.741138 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 22/41] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:41 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1210 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:38:41.974872 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-48564630-1726-4b6e-aff4-c4fe2232ffc5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:41.987489 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-48564630-1726-4b6e-aff4-c4fe2232ffc5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:41.991908 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-48564630-1726-4b6e-aff4-c4fe2232ffc5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:41.995223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-48564630-1726-4b6e-aff4-c4fe2232ffc5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1282 microversion: 2.20 time: 0.278580 Aug 24 13:38:41.997173 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 20/42] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:38:41 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1282 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:38:42.128961 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-186eea46-18dd-4003-b9a7-c9650bf171ca tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:42.135751 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-186eea46-18dd-4003-b9a7-c9650bf171ca tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:42.237150 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-186eea46-18dd-4003-b9a7-c9650bf171ca tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:42.245423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-186eea46-18dd-4003-b9a7-c9650bf171ca tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1241 microversion: 2.1 time: 0.122562 Aug 24 13:38:42.246512 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 23/43] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:42 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1241 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:42.771538 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-91a3d098-f147-4942-8a71-710ca70d2399 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:42.779091 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-91a3d098-f147-4942-8a71-710ca70d2399 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:42.792839 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-91a3d098-f147-4942-8a71-710ca70d2399 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:42.793370 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-91a3d098-f147-4942-8a71-710ca70d2399 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:42.793926 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-91a3d098-f147-4942-8a71-710ca70d2399 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:42.794672 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-91a3d098-f147-4942-8a71-710ca70d2399 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:42.797141 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-91a3d098-f147-4942-8a71-710ca70d2399 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:42.798377 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-91a3d098-f147-4942-8a71-710ca70d2399 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:42.981638 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-91a3d098-f147-4942-8a71-710ca70d2399 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:42.991336 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-91a3d098-f147-4942-8a71-710ca70d2399 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1274 microversion: 2.1 time: 0.228612 Aug 24 13:38:43.005918 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 21/44] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:42 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1274 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:43.036509 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-0d69cbb8-9eb5-443f-a192-23002fd18fca tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:43.037887 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-0d69cbb8-9eb5-443f-a192-23002fd18fca tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:43.237799 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-0d69cbb8-9eb5-443f-a192-23002fd18fca tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:43.253709 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-0d69cbb8-9eb5-443f-a192-23002fd18fca tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:43.261052 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-0d69cbb8-9eb5-443f-a192-23002fd18fca tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:43.265526 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-0d69cbb8-9eb5-443f-a192-23002fd18fca tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1282 microversion: 2.20 time: 0.243436 Aug 24 13:38:43.289122 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 24/45] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:38:43 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1282 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:38:43.291557 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-f54bc951-e37e-40b8-8ba5-14f26999d7bd tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:43.293756 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-f54bc951-e37e-40b8-8ba5-14f26999d7bd tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:43.333988 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f54bc951-e37e-40b8-8ba5-14f26999d7bd tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:43.344517 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f54bc951-e37e-40b8-8ba5-14f26999d7bd tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:43.344517 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f54bc951-e37e-40b8-8ba5-14f26999d7bd tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:43.347261 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f54bc951-e37e-40b8-8ba5-14f26999d7bd tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:43.349061 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f54bc951-e37e-40b8-8ba5-14f26999d7bd tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:43.349784 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f54bc951-e37e-40b8-8ba5-14f26999d7bd tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:43.459298 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-f54bc951-e37e-40b8-8ba5-14f26999d7bd tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:43.472653 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-f54bc951-e37e-40b8-8ba5-14f26999d7bd tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1245 microversion: 2.1 time: 0.192180 Aug 24 13:38:43.473966 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 22/46] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:43 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1245 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:44.019006 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-28c3247b-8b9c-48ea-b439-8755ad3c3a36 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:44.020211 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-28c3247b-8b9c-48ea-b439-8755ad3c3a36 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:44.045805 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-28c3247b-8b9c-48ea-b439-8755ad3c3a36 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:44.046655 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-28c3247b-8b9c-48ea-b439-8755ad3c3a36 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:44.051251 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-28c3247b-8b9c-48ea-b439-8755ad3c3a36 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:44.053607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-28c3247b-8b9c-48ea-b439-8755ad3c3a36 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:44.054212 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-329f3763-bc41-4960-9b90-16509beae25e tempest-VolumesTestJSON-778787871 tempest-VolumesTestJSON-778787871-project] Calling method '.version_select at 0x7f96c2ddd430>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:44.055415 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-28c3247b-8b9c-48ea-b439-8755ad3c3a36 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:44.063860 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-28c3247b-8b9c-48ea-b439-8755ad3c3a36 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:44.191730 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-329f3763-bc41-4960-9b90-16509beae25e tempest-VolumesTestJSON-778787871 tempest-VolumesTestJSON-778787871-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/ccade019-f35a-47a1-b1fe-a8b1fab74a20" status: 200 len: 350 microversion: 2.1 time: 0.141350 Aug 24 13:38:44.192874 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 23/47] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 13:38:44 2022] GET /compute/v2.1/os-volumes/ccade019-f35a-47a1-b1fe-a8b1fab74a20 => generated 350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:38:44.300946 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-7792e462-fa7b-492c-86ba-16506b9895f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:44.303860 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-7792e462-fa7b-492c-86ba-16506b9895f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:44.337863 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-28c3247b-8b9c-48ea-b439-8755ad3c3a36 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:44.342306 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7792e462-fa7b-492c-86ba-16506b9895f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:44.343942 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7792e462-fa7b-492c-86ba-16506b9895f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:44.347176 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7792e462-fa7b-492c-86ba-16506b9895f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:44.350627 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7792e462-fa7b-492c-86ba-16506b9895f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:44.356119 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7792e462-fa7b-492c-86ba-16506b9895f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:44.357959 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-28c3247b-8b9c-48ea-b439-8755ad3c3a36 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1272 microversion: 2.1 time: 0.347572 Aug 24 13:38:44.359481 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7792e462-fa7b-492c-86ba-16506b9895f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:44.366084 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 25/48] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:44 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1272 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:44.506480 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-2229e316-50d3-4b06-b52b-c4706e257874 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:44.508142 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-2229e316-50d3-4b06-b52b-c4706e257874 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:44.524253 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2229e316-50d3-4b06-b52b-c4706e257874 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:44.524956 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2229e316-50d3-4b06-b52b-c4706e257874 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:44.525731 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2229e316-50d3-4b06-b52b-c4706e257874 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:44.526810 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2229e316-50d3-4b06-b52b-c4706e257874 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:44.527638 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2229e316-50d3-4b06-b52b-c4706e257874 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:44.528386 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2229e316-50d3-4b06-b52b-c4706e257874 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:44.648403 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-7792e462-fa7b-492c-86ba-16506b9895f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:44.683733 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-7792e462-fa7b-492c-86ba-16506b9895f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:44.687313 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-7792e462-fa7b-492c-86ba-16506b9895f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:44.691434 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-7792e462-fa7b-492c-86ba-16506b9895f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1278 microversion: 2.20 time: 0.397977 Aug 24 13:38:44.712921 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 24/49] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:38:44 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1278 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:38:44.721925 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2229e316-50d3-4b06-b52b-c4706e257874 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:44.753000 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-2229e316-50d3-4b06-b52b-c4706e257874 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1237 microversion: 2.1 time: 0.252487 Aug 24 13:38:44.755902 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 26/50] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:44 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1237 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:38:45.395369 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-080dd72e-09a6-41d3-8472-62b94d95e039 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:45.396054 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-080dd72e-09a6-41d3-8472-62b94d95e039 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:45.449986 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-080dd72e-09a6-41d3-8472-62b94d95e039 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:45.450483 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-080dd72e-09a6-41d3-8472-62b94d95e039 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:45.450933 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-080dd72e-09a6-41d3-8472-62b94d95e039 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:45.451665 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-080dd72e-09a6-41d3-8472-62b94d95e039 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:45.452131 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-080dd72e-09a6-41d3-8472-62b94d95e039 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:45.468469 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-080dd72e-09a6-41d3-8472-62b94d95e039 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:45.744270 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d0e77dc4-c578-4561-a226-e3934166d994 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:45.745255 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-d0e77dc4-c578-4561-a226-e3934166d994 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:45.789366 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d0e77dc4-c578-4561-a226-e3934166d994 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:45.790278 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d0e77dc4-c578-4561-a226-e3934166d994 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:45.790983 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d0e77dc4-c578-4561-a226-e3934166d994 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:45.791905 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d0e77dc4-c578-4561-a226-e3934166d994 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:45.792541 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d0e77dc4-c578-4561-a226-e3934166d994 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:45.793166 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d0e77dc4-c578-4561-a226-e3934166d994 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:46.010663 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d0e77dc4-c578-4561-a226-e3934166d994 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:46.055614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d0e77dc4-c578-4561-a226-e3934166d994 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:46.067230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d0e77dc4-c578-4561-a226-e3934166d994 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:46.070072 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-d0e77dc4-c578-4561-a226-e3934166d994 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1334 microversion: 2.20 time: 0.333242 Aug 24 13:38:46.112866 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 27/51] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:38:45 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1334 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:38:46.148675 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-1376961d-8924-4b8f-844a-c8233bf08dc1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:46.150166 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-1376961d-8924-4b8f-844a-c8233bf08dc1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:46.174449 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1376961d-8924-4b8f-844a-c8233bf08dc1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:46.177844 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1376961d-8924-4b8f-844a-c8233bf08dc1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:46.179366 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1376961d-8924-4b8f-844a-c8233bf08dc1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:46.187319 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1376961d-8924-4b8f-844a-c8233bf08dc1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:46.194148 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1376961d-8924-4b8f-844a-c8233bf08dc1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:46.200787 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1376961d-8924-4b8f-844a-c8233bf08dc1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:46.797668 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-1376961d-8924-4b8f-844a-c8233bf08dc1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:46.811448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-1376961d-8924-4b8f-844a-c8233bf08dc1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1301 microversion: 2.1 time: 0.696103 Aug 24 13:38:46.813628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 28/52] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:46 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1301 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:46.910416 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-080dd72e-09a6-41d3-8472-62b94d95e039 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:46.957089 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-080dd72e-09a6-41d3-8472-62b94d95e039 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1314 microversion: 2.1 time: 1.560953 Aug 24 13:38:47.002486 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 25/53] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:45 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1314 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:47.119161 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-bfc277f7-2b31-4feb-988c-f2c7d179e729 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:47.119856 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-bfc277f7-2b31-4feb-988c-f2c7d179e729 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:47.127618 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bfc277f7-2b31-4feb-988c-f2c7d179e729 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:47.128378 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bfc277f7-2b31-4feb-988c-f2c7d179e729 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:47.129001 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bfc277f7-2b31-4feb-988c-f2c7d179e729 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:47.130017 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bfc277f7-2b31-4feb-988c-f2c7d179e729 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:47.130654 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bfc277f7-2b31-4feb-988c-f2c7d179e729 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:47.131263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bfc277f7-2b31-4feb-988c-f2c7d179e729 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:47.300830 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-bfc277f7-2b31-4feb-988c-f2c7d179e729 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:47.320599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-bfc277f7-2b31-4feb-988c-f2c7d179e729 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:47.323496 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-bfc277f7-2b31-4feb-988c-f2c7d179e729 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:47.328073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-bfc277f7-2b31-4feb-988c-f2c7d179e729 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1340 microversion: 2.20 time: 0.213416 Aug 24 13:38:47.332502 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 29/54] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:38:47 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1340 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:38:47.653816 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-30ee79bc-1105-42b8-9cc0-d02ed50338e2 tempest-VolumesTestJSON-778787871 tempest-VolumesTestJSON-778787871-project] Calling method '.version_select at 0x7f96c2d2b1f0>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:47.837819 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-004756cc-61e1-4433-86e1-fb7fa22a0221 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:47.839231 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-004756cc-61e1-4433-86e1-fb7fa22a0221 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:47.851866 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-004756cc-61e1-4433-86e1-fb7fa22a0221 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:47.855568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-004756cc-61e1-4433-86e1-fb7fa22a0221 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:47.857667 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-004756cc-61e1-4433-86e1-fb7fa22a0221 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:47.858474 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-004756cc-61e1-4433-86e1-fb7fa22a0221 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:47.859060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-004756cc-61e1-4433-86e1-fb7fa22a0221 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:47.863627 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-004756cc-61e1-4433-86e1-fb7fa22a0221 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:47.887389 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-30ee79bc-1105-42b8-9cc0-d02ed50338e2 tempest-VolumesTestJSON-778787871 tempest-VolumesTestJSON-778787871-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/f417662d-9055-41db-9362-6c1cb2bc6467" status: 200 len: 351 microversion: 2.1 time: 0.237950 Aug 24 13:38:47.888283 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 26/55] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 13:38:47 2022] GET /compute/v2.1/os-volumes/f417662d-9055-41db-9362-6c1cb2bc6467 => generated 351 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:38:47.903713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-9cc00547-72ee-471e-8a1e-d69c7e6aa377 tempest-VolumesTestJSON-778787871 tempest-VolumesTestJSON-778787871-project] Calling method '.version_select at 0x7f96c2d97550>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:48.116029 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-9cc00547-72ee-471e-8a1e-d69c7e6aa377 tempest-VolumesTestJSON-778787871 tempest-VolumesTestJSON-778787871-project] 10.222.0.73 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.215344 Aug 24 13:38:48.116029 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 27/56] 10.222.0.73 () {58 vars in 1134 bytes} [Wed Aug 24 13:38:47 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:48.120763 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-8b569e76-d439-412f-9e9d-b9b8270f31ce tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:48.121798 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-8b569e76-d439-412f-9e9d-b9b8270f31ce tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:48.131695 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8b569e76-d439-412f-9e9d-b9b8270f31ce tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:48.132708 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8b569e76-d439-412f-9e9d-b9b8270f31ce tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:48.133758 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8b569e76-d439-412f-9e9d-b9b8270f31ce tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:48.134911 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8b569e76-d439-412f-9e9d-b9b8270f31ce tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:48.135675 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8b569e76-d439-412f-9e9d-b9b8270f31ce tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:48.136459 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8b569e76-d439-412f-9e9d-b9b8270f31ce tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:48.177300 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-004756cc-61e1-4433-86e1-fb7fa22a0221 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:48.190496 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-004756cc-61e1-4433-86e1-fb7fa22a0221 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1299 microversion: 2.1 time: 0.359061 Aug 24 13:38:48.191666 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 30/57] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:47 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1299 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:48.211614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-71134628-4de6-4b4a-874b-9f041316261b tempest-VolumesTestJSON-778787871 tempest-VolumesTestJSON-778787871-project] Calling method '.version_select at 0x7f96c258a9d0>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:48.451148 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-71134628-4de6-4b4a-874b-9f041316261b tempest-VolumesTestJSON-778787871 tempest-VolumesTestJSON-778787871-project] 10.222.0.73 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.248518 Aug 24 13:38:48.451798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 31/58] 10.222.0.73 () {58 vars in 1149 bytes} [Wed Aug 24 13:38:48 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:38:48.459954 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-c32e7f8a-a012-4833-9b7a-2977bd8a23a7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:48.463817 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-c32e7f8a-a012-4833-9b7a-2977bd8a23a7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:48.475433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c32e7f8a-a012-4833-9b7a-2977bd8a23a7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:48.475433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c32e7f8a-a012-4833-9b7a-2977bd8a23a7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:48.475433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c32e7f8a-a012-4833-9b7a-2977bd8a23a7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:48.476291 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c32e7f8a-a012-4833-9b7a-2977bd8a23a7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:48.476983 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c32e7f8a-a012-4833-9b7a-2977bd8a23a7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:48.477595 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c32e7f8a-a012-4833-9b7a-2977bd8a23a7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:48.772919 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c32e7f8a-a012-4833-9b7a-2977bd8a23a7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:48.810286 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c32e7f8a-a012-4833-9b7a-2977bd8a23a7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:48.815437 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c32e7f8a-a012-4833-9b7a-2977bd8a23a7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:48.823969 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-c32e7f8a-a012-4833-9b7a-2977bd8a23a7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1340 microversion: 2.20 time: 0.369341 Aug 24 13:38:48.843996 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 32/59] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:38:48 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1340 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:38:48.849783 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-213fe6cf-b21a-48d7-9bff-d0985674d2b5 tempest-VolumesTestJSON-778787871 tempest-VolumesTestJSON-778787871-project] Calling method '.version_select at 0x7f96c25cc790>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:48.990271 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-8b569e76-d439-412f-9e9d-b9b8270f31ce tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:49.012336 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-8b569e76-d439-412f-9e9d-b9b8270f31ce tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1314 microversion: 2.1 time: 0.895786 Aug 24 13:38:49.012955 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 28/60] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:48 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1314 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:49.082706 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-213fe6cf-b21a-48d7-9bff-d0985674d2b5 tempest-VolumesTestJSON-778787871 tempest-VolumesTestJSON-778787871-project] 10.222.0.73 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.243520 Aug 24 13:38:49.083311 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 33/61] 10.222.0.73 () {58 vars in 1134 bytes} [Wed Aug 24 13:38:48 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:49.099469 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-237bcb11-012c-4464-a142-c99faa516192 tempest-VolumesTestJSON-778787871 tempest-VolumesTestJSON-778787871-project] Calling method '.version_select at 0x7f96c2d2b790>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:49.215678 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-f1c57b8a-eaa4-4687-9ea8-3940c721c918 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:49.216340 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-f1c57b8a-eaa4-4687-9ea8-3940c721c918 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:49.230773 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f1c57b8a-eaa4-4687-9ea8-3940c721c918 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:49.232866 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f1c57b8a-eaa4-4687-9ea8-3940c721c918 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:49.234868 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f1c57b8a-eaa4-4687-9ea8-3940c721c918 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:49.236135 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f1c57b8a-eaa4-4687-9ea8-3940c721c918 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:49.236682 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f1c57b8a-eaa4-4687-9ea8-3940c721c918 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:49.237160 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f1c57b8a-eaa4-4687-9ea8-3940c721c918 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:49.308544 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-237bcb11-012c-4464-a142-c99faa516192 tempest-VolumesTestJSON-778787871 tempest-VolumesTestJSON-778787871-project] 10.222.0.73 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.214904 Aug 24 13:38:49.309508 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 29/62] 10.222.0.73 () {58 vars in 1167 bytes} [Wed Aug 24 13:38:49 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:38:49.334500 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-ceb9cf84-1005-4185-ab27-571dfc9c4447 tempest-VolumesTestJSON-778787871 tempest-VolumesTestJSON-778787871-project] Calling method '.version_select at 0x7f96c2d97b80>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:49.526391 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-ceb9cf84-1005-4185-ab27-571dfc9c4447 tempest-VolumesTestJSON-778787871 tempest-VolumesTestJSON-778787871-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.200415 Aug 24 13:38:49.529132 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 30/63] 10.222.0.73 () {58 vars in 1170 bytes} [Wed Aug 24 13:38:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:38:49.587135 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-82f000f2-5857-409d-b048-390f8a53d12c tempest-VolumesTestJSON-778787871 tempest-VolumesTestJSON-778787871-project] Calling method '.version_select at 0x7f96c2d3ca60>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:49.935710 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-82f000f2-5857-409d-b048-390f8a53d12c tempest-VolumesTestJSON-778787871 tempest-VolumesTestJSON-778787871-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.380755 Aug 24 13:38:49.936077 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f1c57b8a-eaa4-4687-9ea8-3940c721c918 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:49.949467 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 31/64] 10.222.0.73 () {58 vars in 1155 bytes} [Wed Aug 24 13:38:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:38:49.965140 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-0571c548-901a-4265-aa90-147befb1ff34 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:49.967272 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-0571c548-901a-4265-aa90-147befb1ff34 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:49.975531 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-f1c57b8a-eaa4-4687-9ea8-3940c721c918 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1366 microversion: 2.1 time: 0.763827 Aug 24 13:38:50.001708 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 34/65] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:49 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1366 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:50.005309 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=4 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:38:50.014198 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0571c548-901a-4265-aa90-147befb1ff34 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:50.017672 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0571c548-901a-4265-aa90-147befb1ff34 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:50.018207 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-10d7fb62-0db6-416d-92e2-337968db2a44 tempest-VolumesTestJSON-778787871 tempest-VolumesTestJSON-778787871-project] Calling method '.version_select at 0x7f96c258a8b0>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:50.021089 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0571c548-901a-4265-aa90-147befb1ff34 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:50.023671 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0571c548-901a-4265-aa90-147befb1ff34 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:50.034969 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0571c548-901a-4265-aa90-147befb1ff34 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:50.036938 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0571c548-901a-4265-aa90-147befb1ff34 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:50.243905 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-10d7fb62-0db6-416d-92e2-337968db2a44 tempest-VolumesTestJSON-778787871 tempest-VolumesTestJSON-778787871-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.244819 Aug 24 13:38:50.245465 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 35/66] 10.222.0.73 () {58 vars in 1188 bytes} [Wed Aug 24 13:38:49 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:38:50.260457 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-f3ccc2f1-5bd6-4d67-b221-f48f0b757e1f tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:50.261749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-f3ccc2f1-5bd6-4d67-b221-f48f0b757e1f tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:50.273994 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f3ccc2f1-5bd6-4d67-b221-f48f0b757e1f tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:50.276969 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f3ccc2f1-5bd6-4d67-b221-f48f0b757e1f tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:50.276969 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f3ccc2f1-5bd6-4d67-b221-f48f0b757e1f tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:50.276969 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f3ccc2f1-5bd6-4d67-b221-f48f0b757e1f tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:50.277771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f3ccc2f1-5bd6-4d67-b221-f48f0b757e1f tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:50.278475 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f3ccc2f1-5bd6-4d67-b221-f48f0b757e1f tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:50.372290 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=2 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:38:50.831916 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0571c548-901a-4265-aa90-147befb1ff34 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:50.858641 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0571c548-901a-4265-aa90-147befb1ff34 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:50.863011 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0571c548-901a-4265-aa90-147befb1ff34 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:50.865884 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-0571c548-901a-4265-aa90-147befb1ff34 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1408 microversion: 2.20 time: 0.913980 Aug 24 13:38:50.866779 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 32/67] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:38:49 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1408 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:38:50.998558 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f3ccc2f1-5bd6-4d67-b221-f48f0b757e1f tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:50.998558 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-f3ccc2f1-5bd6-4d67-b221-f48f0b757e1f tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1314 microversion: 2.1 time: 0.749444 Aug 24 13:38:50.998558 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 36/68] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:50 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1314 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:51.027111 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-ec3752b7-8b8c-417f-94f1-d14887289b0f tempest-VolumesTestJSON-778787871 tempest-VolumesTestJSON-778787871-project] Calling method '.version_select at 0x7f96c4019f70>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:51.204864 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-ec3752b7-8b8c-417f-94f1-d14887289b0f tempest-VolumesTestJSON-778787871 tempest-VolumesTestJSON-778787871-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.205899 Aug 24 13:38:51.205837 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 37/69] 10.222.0.73 () {58 vars in 1155 bytes} [Wed Aug 24 13:38:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:51.218270 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-8a9e8c38-5eb7-4c19-b211-5f8854a15a75 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:51.219759 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-8a9e8c38-5eb7-4c19-b211-5f8854a15a75 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:51.237180 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8a9e8c38-5eb7-4c19-b211-5f8854a15a75 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:51.238061 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8a9e8c38-5eb7-4c19-b211-5f8854a15a75 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:51.242182 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8a9e8c38-5eb7-4c19-b211-5f8854a15a75 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:51.255192 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8a9e8c38-5eb7-4c19-b211-5f8854a15a75 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:51.255192 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8a9e8c38-5eb7-4c19-b211-5f8854a15a75 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:51.255192 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8a9e8c38-5eb7-4c19-b211-5f8854a15a75 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:51.294717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-3559b604-2df2-4c97-a417-d3295ba6742e req-9fa9a62d-488d-4e96-9a76-dc3a530b58d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41fef0de-6828-4680-ade1-e4c25d189d6e", "tag": "7bc85c4a-d736-4e8a-86bf-61d6911d0812"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:38:51.327715 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=6 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:38:51.335531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-3559b604-2df2-4c97-a417-d3295ba6742e req-9fa9a62d-488d-4e96-9a76-dc3a530b58d8 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:51.335531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-3559b604-2df2-4c97-a417-d3295ba6742e req-9fa9a62d-488d-4e96-9a76-dc3a530b58d8 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:51.335531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-3559b604-2df2-4c97-a417-d3295ba6742e req-9fa9a62d-488d-4e96-9a76-dc3a530b58d8 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:51.423451 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-3559b604-2df2-4c97-a417-d3295ba6742e req-9fa9a62d-488d-4e96-9a76-dc3a530b58d8 service nova] Creating event network-changed:7bc85c4a-d736-4e8a-86bf-61d6911d0812 for instance 41fef0de-6828-4680-ade1-e4c25d189d6e on hv-cinder-77957 Aug 24 13:38:51.424461 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-3559b604-2df2-4c97-a417-d3295ba6742e req-9fa9a62d-488d-4e96-9a76-dc3a530b58d8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=133014) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 13:38:51.425157 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-3559b604-2df2-4c97-a417-d3295ba6742e req-9fa9a62d-488d-4e96-9a76-dc3a530b58d8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=133014) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 13:38:51.427183 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-44535ea5-d478-4fb3-91b9-cf7aa406edec None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:51.428054 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-44535ea5-d478-4fb3-91b9-cf7aa406edec None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:51.428976 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-44535ea5-d478-4fb3-91b9-cf7aa406edec None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:51.439068 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-44535ea5-d478-4fb3-91b9-cf7aa406edec None None] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:51.440566 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-44535ea5-d478-4fb3-91b9-cf7aa406edec None None] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:51.442052 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-44535ea5-d478-4fb3-91b9-cf7aa406edec None None] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:51.483027 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.compute.rpcapi [None req-44535ea5-d478-4fb3-91b9-cf7aa406edec None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 13:38:51.485769 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-44535ea5-d478-4fb3-91b9-cf7aa406edec None None] Releasing lock "compute-rpcapi-router" {{(pid=133014) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 13:38:51.549952 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-44535ea5-d478-4fb3-91b9-cf7aa406edec None None] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.681494 Aug 24 13:38:51.551171 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 33/70] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:38:51.903377 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-9d7f2abf-04bf-4d83-94ed-75a2d0495b25 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:51.903377 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-9d7f2abf-04bf-4d83-94ed-75a2d0495b25 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:51.942593 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d7f2abf-04bf-4d83-94ed-75a2d0495b25 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:51.948418 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d7f2abf-04bf-4d83-94ed-75a2d0495b25 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:51.950512 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d7f2abf-04bf-4d83-94ed-75a2d0495b25 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:51.955227 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d7f2abf-04bf-4d83-94ed-75a2d0495b25 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:51.961034 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d7f2abf-04bf-4d83-94ed-75a2d0495b25 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:51.962198 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d7f2abf-04bf-4d83-94ed-75a2d0495b25 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:51.982884 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=18 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:38:52.755034 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-8a9e8c38-5eb7-4c19-b211-5f8854a15a75 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:52.755034 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-8a9e8c38-5eb7-4c19-b211-5f8854a15a75 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1366 microversion: 2.1 time: 1.445808 Aug 24 13:38:52.755034 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 38/71] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:51 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1366 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:52.755034 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-fb66c897-145c-4950-8172-a21ea0c4aea1 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:52.757200 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-fb66c897-145c-4950-8172-a21ea0c4aea1 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:52.757200 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fb66c897-145c-4950-8172-a21ea0c4aea1 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:52.757200 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fb66c897-145c-4950-8172-a21ea0c4aea1 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:52.757200 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fb66c897-145c-4950-8172-a21ea0c4aea1 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:52.757680 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fb66c897-145c-4950-8172-a21ea0c4aea1 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:52.757680 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fb66c897-145c-4950-8172-a21ea0c4aea1 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:52.757680 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fb66c897-145c-4950-8172-a21ea0c4aea1 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:52.758136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-9d7f2abf-04bf-4d83-94ed-75a2d0495b25 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:52.759663 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-9d7f2abf-04bf-4d83-94ed-75a2d0495b25 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:52.761759 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-9d7f2abf-04bf-4d83-94ed-75a2d0495b25 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:52.763256 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-9d7f2abf-04bf-4d83-94ed-75a2d0495b25 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1408 microversion: 2.20 time: 0.866499 Aug 24 13:38:52.764081 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 34/72] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:38:51 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1408 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:38:53.245302 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=24 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:38:53.316130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-fb66c897-145c-4950-8172-a21ea0c4aea1 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:53.351579 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-fb66c897-145c-4950-8172-a21ea0c4aea1 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1314 microversion: 2.1 time: 0.643426 Aug 24 13:38:53.353243 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 39/73] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:52 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1314 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:53.655253 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-d473275b-2cd5-40fb-ae71-26cdaa8b2d42 req-5b86b5c0-6c86-4d7d-a52f-7a807bf34b2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ad88e6d-b2b8-4049-b987-94022767fa67", "tag": "0723b1a9-9fdc-4151-b023-7ddb25fe09e0"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:38:53.680957 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-d473275b-2cd5-40fb-ae71-26cdaa8b2d42 req-5b86b5c0-6c86-4d7d-a52f-7a807bf34b2e service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:53.682700 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-d473275b-2cd5-40fb-ae71-26cdaa8b2d42 req-5b86b5c0-6c86-4d7d-a52f-7a807bf34b2e service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:53.688597 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-d473275b-2cd5-40fb-ae71-26cdaa8b2d42 req-5b86b5c0-6c86-4d7d-a52f-7a807bf34b2e service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:53.693675 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d9917ef1-5cfa-465f-ab21-fd7257919847 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:53.703858 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-d9917ef1-5cfa-465f-ab21-fd7257919847 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:53.703858 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d9917ef1-5cfa-465f-ab21-fd7257919847 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:53.703858 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d9917ef1-5cfa-465f-ab21-fd7257919847 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:53.703858 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d9917ef1-5cfa-465f-ab21-fd7257919847 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:53.704991 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d9917ef1-5cfa-465f-ab21-fd7257919847 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:53.704991 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d9917ef1-5cfa-465f-ab21-fd7257919847 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:53.719326 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d9917ef1-5cfa-465f-ab21-fd7257919847 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:53.731459 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-d473275b-2cd5-40fb-ae71-26cdaa8b2d42 req-5b86b5c0-6c86-4d7d-a52f-7a807bf34b2e service nova] Creating event network-changed:0723b1a9-9fdc-4151-b023-7ddb25fe09e0 for instance 3ad88e6d-b2b8-4049-b987-94022767fa67 on hv-cinder-77957 Aug 24 13:38:53.755518 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-d473275b-2cd5-40fb-ae71-26cdaa8b2d42 req-5b86b5c0-6c86-4d7d-a52f-7a807bf34b2e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094919 Aug 24 13:38:53.756705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 35/74] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:38:53.798017 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a7eb0ff6-58e6-496f-a0c2-3ad7a1509bff tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:53.798986 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a7eb0ff6-58e6-496f-a0c2-3ad7a1509bff tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:53.821651 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a7eb0ff6-58e6-496f-a0c2-3ad7a1509bff tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:53.823782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a7eb0ff6-58e6-496f-a0c2-3ad7a1509bff tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:53.824903 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a7eb0ff6-58e6-496f-a0c2-3ad7a1509bff tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:53.827625 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a7eb0ff6-58e6-496f-a0c2-3ad7a1509bff tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:53.831715 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a7eb0ff6-58e6-496f-a0c2-3ad7a1509bff tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:53.832347 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a7eb0ff6-58e6-496f-a0c2-3ad7a1509bff tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:54.106976 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d9917ef1-5cfa-465f-ab21-fd7257919847 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:54.118605 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-d9917ef1-5cfa-465f-ab21-fd7257919847 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1366 microversion: 2.1 time: 0.429353 Aug 24 13:38:54.135158 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 40/75] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:53 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1366 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:54.166564 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a7eb0ff6-58e6-496f-a0c2-3ad7a1509bff tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:54.181547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a7eb0ff6-58e6-496f-a0c2-3ad7a1509bff tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:54.183498 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a7eb0ff6-58e6-496f-a0c2-3ad7a1509bff tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:54.184947 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a7eb0ff6-58e6-496f-a0c2-3ad7a1509bff tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1408 microversion: 2.20 time: 0.393562 Aug 24 13:38:54.203513 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 36/76] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:38:53 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1408 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:38:54.382953 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-0a75065b-4ab3-4837-a158-23a986c57971 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:54.383711 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-0a75065b-4ab3-4837-a158-23a986c57971 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:54.395414 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0a75065b-4ab3-4837-a158-23a986c57971 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:54.395414 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0a75065b-4ab3-4837-a158-23a986c57971 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:54.395414 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0a75065b-4ab3-4837-a158-23a986c57971 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:54.397416 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0a75065b-4ab3-4837-a158-23a986c57971 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:54.397886 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0a75065b-4ab3-4837-a158-23a986c57971 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:54.400889 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0a75065b-4ab3-4837-a158-23a986c57971 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:54.797740 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-0a75065b-4ab3-4837-a158-23a986c57971 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:54.839394 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-0a75065b-4ab3-4837-a158-23a986c57971 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1314 microversion: 2.1 time: 0.464740 Aug 24 13:38:54.852811 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 41/77] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:54 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:55.145499 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-0967d84a-555a-4842-b4ea-dd76b4810452 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:55.146189 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-0967d84a-555a-4842-b4ea-dd76b4810452 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:55.168477 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0967d84a-555a-4842-b4ea-dd76b4810452 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:55.169195 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0967d84a-555a-4842-b4ea-dd76b4810452 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:55.171023 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0967d84a-555a-4842-b4ea-dd76b4810452 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:55.172989 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0967d84a-555a-4842-b4ea-dd76b4810452 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:55.173569 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0967d84a-555a-4842-b4ea-dd76b4810452 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:55.174086 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0967d84a-555a-4842-b4ea-dd76b4810452 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:55.530740 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-2df840bb-2c7e-4204-ad20-cd97722fdf79 req-bf7839ba-9a0c-4aef-b0c3-11c656d3b504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53bade32-e7bf-4ace-9b68-0458f257feff", "tag": "55484e25-34c8-469b-8598-d718e9469013"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:38:55.530740 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-2df840bb-2c7e-4204-ad20-cd97722fdf79 req-bf7839ba-9a0c-4aef-b0c3-11c656d3b504 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:55.530740 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-2df840bb-2c7e-4204-ad20-cd97722fdf79 req-bf7839ba-9a0c-4aef-b0c3-11c656d3b504 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:55.530740 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-2df840bb-2c7e-4204-ad20-cd97722fdf79 req-bf7839ba-9a0c-4aef-b0c3-11c656d3b504 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:55.535278 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-2df840bb-2c7e-4204-ad20-cd97722fdf79 req-bf7839ba-9a0c-4aef-b0c3-11c656d3b504 service nova] Creating event network-changed:55484e25-34c8-469b-8598-d718e9469013 for instance 53bade32-e7bf-4ace-9b68-0458f257feff on hv-cinder-77957 Aug 24 13:38:55.535278 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-2df840bb-2c7e-4204-ad20-cd97722fdf79 req-bf7839ba-9a0c-4aef-b0c3-11c656d3b504 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.638666 Aug 24 13:38:55.535278 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 37/78] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:38:55.537607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-0967d84a-555a-4842-b4ea-dd76b4810452 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:55.538984 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-5830e111-7377-4639-8d0a-d5b0b6fc74cd tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:55.538984 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-5830e111-7377-4639-8d0a-d5b0b6fc74cd tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:55.539844 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-0967d84a-555a-4842-b4ea-dd76b4810452 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1366 microversion: 2.1 time: 0.351616 Aug 24 13:38:55.539844 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 42/79] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:55 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1366 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:55.540810 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5830e111-7377-4639-8d0a-d5b0b6fc74cd tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:55.540810 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5830e111-7377-4639-8d0a-d5b0b6fc74cd tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:55.540810 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5830e111-7377-4639-8d0a-d5b0b6fc74cd tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:55.540810 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5830e111-7377-4639-8d0a-d5b0b6fc74cd tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:55.541665 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5830e111-7377-4639-8d0a-d5b0b6fc74cd tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:55.541665 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5830e111-7377-4639-8d0a-d5b0b6fc74cd tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:55.838295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-5830e111-7377-4639-8d0a-d5b0b6fc74cd tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:55.873295 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-c5718e16-d3eb-4716-aa15-5ab7ff9af2b8 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:55.873295 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-c5718e16-d3eb-4716-aa15-5ab7ff9af2b8 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:55.880650 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c5718e16-d3eb-4716-aa15-5ab7ff9af2b8 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:55.887165 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c5718e16-d3eb-4716-aa15-5ab7ff9af2b8 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:55.891268 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c5718e16-d3eb-4716-aa15-5ab7ff9af2b8 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:55.893295 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c5718e16-d3eb-4716-aa15-5ab7ff9af2b8 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:55.896095 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-5830e111-7377-4639-8d0a-d5b0b6fc74cd tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:55.897028 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c5718e16-d3eb-4716-aa15-5ab7ff9af2b8 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:55.898231 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c5718e16-d3eb-4716-aa15-5ab7ff9af2b8 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:55.900932 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-5830e111-7377-4639-8d0a-d5b0b6fc74cd tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:55.904911 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-5830e111-7377-4639-8d0a-d5b0b6fc74cd tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1408 microversion: 2.20 time: 0.421143 Aug 24 13:38:55.907583 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 38/80] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:38:55 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1408 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:38:56.224951 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c5718e16-d3eb-4716-aa15-5ab7ff9af2b8 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:56.236482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-c5718e16-d3eb-4716-aa15-5ab7ff9af2b8 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1314 microversion: 2.1 time: 0.373014 Aug 24 13:38:56.237968 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 43/81] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:55 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:38:56.554150 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a46f7a6b-c9ba-48eb-826f-0d5089dc818c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:56.556479 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a46f7a6b-c9ba-48eb-826f-0d5089dc818c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:56.575929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a46f7a6b-c9ba-48eb-826f-0d5089dc818c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:56.577610 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a46f7a6b-c9ba-48eb-826f-0d5089dc818c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:56.599814 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a46f7a6b-c9ba-48eb-826f-0d5089dc818c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:56.599814 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a46f7a6b-c9ba-48eb-826f-0d5089dc818c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:56.599814 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a46f7a6b-c9ba-48eb-826f-0d5089dc818c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:56.599814 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a46f7a6b-c9ba-48eb-826f-0d5089dc818c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:56.920339 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a46f7a6b-c9ba-48eb-826f-0d5089dc818c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:56.938695 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a46f7a6b-c9ba-48eb-826f-0d5089dc818c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1366 microversion: 2.1 time: 0.391642 Aug 24 13:38:56.939656 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 39/82] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:56 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1366 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:56.959421 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-193d6748-d540-40fb-8ba3-8fb0521573b8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:56.960050 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-193d6748-d540-40fb-8ba3-8fb0521573b8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:57.002403 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-193d6748-d540-40fb-8ba3-8fb0521573b8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:57.002403 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-193d6748-d540-40fb-8ba3-8fb0521573b8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:57.005729 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-193d6748-d540-40fb-8ba3-8fb0521573b8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:57.005729 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-193d6748-d540-40fb-8ba3-8fb0521573b8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:57.007502 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-193d6748-d540-40fb-8ba3-8fb0521573b8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:57.008052 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-193d6748-d540-40fb-8ba3-8fb0521573b8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:57.030913 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=100 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:38:57.280291 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-ebdbd7ff-c3b4-4c2f-8da7-9f772a9f99fc tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:57.281391 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-ebdbd7ff-c3b4-4c2f-8da7-9f772a9f99fc tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:57.295946 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ebdbd7ff-c3b4-4c2f-8da7-9f772a9f99fc tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:57.300668 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ebdbd7ff-c3b4-4c2f-8da7-9f772a9f99fc tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:57.300668 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ebdbd7ff-c3b4-4c2f-8da7-9f772a9f99fc tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:57.306893 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ebdbd7ff-c3b4-4c2f-8da7-9f772a9f99fc tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:57.307764 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ebdbd7ff-c3b4-4c2f-8da7-9f772a9f99fc tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:57.308878 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ebdbd7ff-c3b4-4c2f-8da7-9f772a9f99fc tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:57.501481 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-193d6748-d540-40fb-8ba3-8fb0521573b8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:57.520000 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-193d6748-d540-40fb-8ba3-8fb0521573b8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:57.527640 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-193d6748-d540-40fb-8ba3-8fb0521573b8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:57.532861 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-193d6748-d540-40fb-8ba3-8fb0521573b8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1408 microversion: 2.20 time: 0.583920 Aug 24 13:38:57.549392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 44/83] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:38:56 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1408 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:38:57.970520 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-4fedcb34-928d-484f-aff6-965c168936bf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:57.971123 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-4fedcb34-928d-484f-aff6-965c168936bf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:57.979726 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4fedcb34-928d-484f-aff6-965c168936bf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:57.986487 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-ebdbd7ff-c3b4-4c2f-8da7-9f772a9f99fc tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:57.991780 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4fedcb34-928d-484f-aff6-965c168936bf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:57.992251 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4fedcb34-928d-484f-aff6-965c168936bf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:57.992999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4fedcb34-928d-484f-aff6-965c168936bf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:57.993453 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4fedcb34-928d-484f-aff6-965c168936bf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:57.993876 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4fedcb34-928d-484f-aff6-965c168936bf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:57.998677 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-ebdbd7ff-c3b4-4c2f-8da7-9f772a9f99fc tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1314 microversion: 2.1 time: 0.723527 Aug 24 13:38:57.999263 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 40/84] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:57 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1314 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:58.269626 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4fedcb34-928d-484f-aff6-965c168936bf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:58.289395 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-4fedcb34-928d-484f-aff6-965c168936bf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1366 microversion: 2.1 time: 0.325385 Aug 24 13:38:58.291204 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 45/85] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:57 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:58.575477 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-481f3c73-5e98-41f0-b1b9-aff53e3a86f1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:58.576203 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-481f3c73-5e98-41f0-b1b9-aff53e3a86f1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:58.586262 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-481f3c73-5e98-41f0-b1b9-aff53e3a86f1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:58.587116 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-481f3c73-5e98-41f0-b1b9-aff53e3a86f1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:58.589013 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-481f3c73-5e98-41f0-b1b9-aff53e3a86f1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:58.590095 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-481f3c73-5e98-41f0-b1b9-aff53e3a86f1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:58.590791 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-481f3c73-5e98-41f0-b1b9-aff53e3a86f1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:58.591518 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-481f3c73-5e98-41f0-b1b9-aff53e3a86f1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:58.950477 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-481f3c73-5e98-41f0-b1b9-aff53e3a86f1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:58.965911 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-481f3c73-5e98-41f0-b1b9-aff53e3a86f1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:58.974693 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-481f3c73-5e98-41f0-b1b9-aff53e3a86f1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:58.978627 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-481f3c73-5e98-41f0-b1b9-aff53e3a86f1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1408 microversion: 2.20 time: 0.410579 Aug 24 13:38:58.980215 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 41/86] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:38:58 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1408 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:38:59.027591 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b558caa9-3b42-468a-b0d7-55d0da83f38d tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:59.028913 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b558caa9-3b42-468a-b0d7-55d0da83f38d tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:59.035299 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:38:59.037599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b558caa9-3b42-468a-b0d7-55d0da83f38d tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:59.038071 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b558caa9-3b42-468a-b0d7-55d0da83f38d tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:59.038726 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b558caa9-3b42-468a-b0d7-55d0da83f38d tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:59.039639 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b558caa9-3b42-468a-b0d7-55d0da83f38d tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:59.040524 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b558caa9-3b42-468a-b0d7-55d0da83f38d tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:59.041160 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b558caa9-3b42-468a-b0d7-55d0da83f38d tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:59.314186 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-583ae513-9640-4a35-9bd5-ca3e29887be7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:38:59.323667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-583ae513-9640-4a35-9bd5-ca3e29887be7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:38:59.326263 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-583ae513-9640-4a35-9bd5-ca3e29887be7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:59.328911 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-583ae513-9640-4a35-9bd5-ca3e29887be7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:59.331253 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-583ae513-9640-4a35-9bd5-ca3e29887be7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:59.332950 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b558caa9-3b42-468a-b0d7-55d0da83f38d tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:59.334881 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-583ae513-9640-4a35-9bd5-ca3e29887be7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:38:59.335671 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-583ae513-9640-4a35-9bd5-ca3e29887be7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:38:59.336959 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-583ae513-9640-4a35-9bd5-ca3e29887be7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:38:59.353165 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b558caa9-3b42-468a-b0d7-55d0da83f38d tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1314 microversion: 2.1 time: 0.331839 Aug 24 13:38:59.354969 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 46/87] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:59 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:38:59.661392 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-583ae513-9640-4a35-9bd5-ca3e29887be7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:38:59.683741 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-583ae513-9640-4a35-9bd5-ca3e29887be7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1366 microversion: 2.1 time: 0.375572 Aug 24 13:38:59.684682 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 42/88] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:38:59 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1366 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:00.028672 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b49b597c-d5e5-4eb7-8f2d-fbb7a912cda4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:00.031443 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b49b597c-d5e5-4eb7-8f2d-fbb7a912cda4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:00.061013 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b49b597c-d5e5-4eb7-8f2d-fbb7a912cda4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:00.062454 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b49b597c-d5e5-4eb7-8f2d-fbb7a912cda4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:00.063525 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b49b597c-d5e5-4eb7-8f2d-fbb7a912cda4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:00.064880 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b49b597c-d5e5-4eb7-8f2d-fbb7a912cda4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:00.065763 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b49b597c-d5e5-4eb7-8f2d-fbb7a912cda4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:00.066570 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b49b597c-d5e5-4eb7-8f2d-fbb7a912cda4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:00.325954 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b49b597c-d5e5-4eb7-8f2d-fbb7a912cda4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:00.382379 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-44ae8d4f-a1ba-4c9e-ba76-c07038ef4413 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:00.388058 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-44ae8d4f-a1ba-4c9e-ba76-c07038ef4413 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:00.389139 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b49b597c-d5e5-4eb7-8f2d-fbb7a912cda4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:00.396670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b49b597c-d5e5-4eb7-8f2d-fbb7a912cda4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:00.398354 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b49b597c-d5e5-4eb7-8f2d-fbb7a912cda4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1408 microversion: 2.20 time: 0.377738 Aug 24 13:39:00.400010 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 47/89] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:39:00 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1408 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:39:00.400168 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-44ae8d4f-a1ba-4c9e-ba76-c07038ef4413 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:00.400969 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-44ae8d4f-a1ba-4c9e-ba76-c07038ef4413 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:00.402412 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-44ae8d4f-a1ba-4c9e-ba76-c07038ef4413 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:00.404351 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-44ae8d4f-a1ba-4c9e-ba76-c07038ef4413 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:00.405414 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-44ae8d4f-a1ba-4c9e-ba76-c07038ef4413 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:00.406971 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-44ae8d4f-a1ba-4c9e-ba76-c07038ef4413 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:00.446157 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=100 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:39:00.674841 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-44ae8d4f-a1ba-4c9e-ba76-c07038ef4413 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:00.690531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-44ae8d4f-a1ba-4c9e-ba76-c07038ef4413 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1314 microversion: 2.1 time: 0.316269 Aug 24 13:39:00.709041 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 43/90] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:00 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:00.726539 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-f5611f02-3ae3-4340-bbf7-7d00d796f97e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:00.729762 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-f5611f02-3ae3-4340-bbf7-7d00d796f97e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:00.758778 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f5611f02-3ae3-4340-bbf7-7d00d796f97e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:00.763540 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f5611f02-3ae3-4340-bbf7-7d00d796f97e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:00.763540 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f5611f02-3ae3-4340-bbf7-7d00d796f97e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:00.763540 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f5611f02-3ae3-4340-bbf7-7d00d796f97e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:00.763540 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f5611f02-3ae3-4340-bbf7-7d00d796f97e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:00.766580 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f5611f02-3ae3-4340-bbf7-7d00d796f97e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:01.027623 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f5611f02-3ae3-4340-bbf7-7d00d796f97e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:01.051532 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-f5611f02-3ae3-4340-bbf7-7d00d796f97e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1366 microversion: 2.1 time: 0.334899 Aug 24 13:39:01.054782 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 48/91] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:00 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:01.423246 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-7aa83c70-4420-4766-ad98-264d0dc19062 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:01.424060 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-7aa83c70-4420-4766-ad98-264d0dc19062 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:01.430612 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7aa83c70-4420-4766-ad98-264d0dc19062 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:01.431113 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7aa83c70-4420-4766-ad98-264d0dc19062 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:01.431556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7aa83c70-4420-4766-ad98-264d0dc19062 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:01.432388 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7aa83c70-4420-4766-ad98-264d0dc19062 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:01.432852 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7aa83c70-4420-4766-ad98-264d0dc19062 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:01.433549 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7aa83c70-4420-4766-ad98-264d0dc19062 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:01.462639 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=2 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:39:01.599153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-7aa83c70-4420-4766-ad98-264d0dc19062 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:01.614630 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-7aa83c70-4420-4766-ad98-264d0dc19062 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:01.617710 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-7aa83c70-4420-4766-ad98-264d0dc19062 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:01.619620 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-7aa83c70-4420-4766-ad98-264d0dc19062 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1408 microversion: 2.20 time: 0.200816 Aug 24 13:39:01.620646 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 44/92] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:39:01 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1408 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:39:01.736772 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-769ede05-eeb2-417b-b0bd-a55721d77d29 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:01.743078 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-769ede05-eeb2-417b-b0bd-a55721d77d29 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:01.751121 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-769ede05-eeb2-417b-b0bd-a55721d77d29 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:01.759354 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-769ede05-eeb2-417b-b0bd-a55721d77d29 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:01.759851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-769ede05-eeb2-417b-b0bd-a55721d77d29 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:01.766463 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-769ede05-eeb2-417b-b0bd-a55721d77d29 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:01.766892 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-769ede05-eeb2-417b-b0bd-a55721d77d29 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:01.767369 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-769ede05-eeb2-417b-b0bd-a55721d77d29 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:02.070779 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-769ede05-eeb2-417b-b0bd-a55721d77d29 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:02.089665 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-769ede05-eeb2-417b-b0bd-a55721d77d29 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1314 microversion: 2.1 time: 0.361055 Aug 24 13:39:02.102333 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-eaec9142-95e4-4f29-8e13-557b12269abf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:02.103080 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-eaec9142-95e4-4f29-8e13-557b12269abf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:02.121031 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 49/93] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:01 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:02.132539 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eaec9142-95e4-4f29-8e13-557b12269abf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:02.132539 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eaec9142-95e4-4f29-8e13-557b12269abf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:02.132539 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eaec9142-95e4-4f29-8e13-557b12269abf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:02.132539 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eaec9142-95e4-4f29-8e13-557b12269abf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:02.133048 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eaec9142-95e4-4f29-8e13-557b12269abf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:02.133513 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eaec9142-95e4-4f29-8e13-557b12269abf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:02.475794 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-eaec9142-95e4-4f29-8e13-557b12269abf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:02.498018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-eaec9142-95e4-4f29-8e13-557b12269abf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1366 microversion: 2.1 time: 0.400158 Aug 24 13:39:02.508655 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 45/94] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:02 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1366 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:39:02.681949 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-e16c8b35-d042-4221-9be6-9fd992c862e3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:02.684842 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-e16c8b35-d042-4221-9be6-9fd992c862e3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:02.696315 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e16c8b35-d042-4221-9be6-9fd992c862e3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:02.697590 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e16c8b35-d042-4221-9be6-9fd992c862e3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:02.698585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e16c8b35-d042-4221-9be6-9fd992c862e3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:02.699789 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e16c8b35-d042-4221-9be6-9fd992c862e3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:02.701142 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e16c8b35-d042-4221-9be6-9fd992c862e3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:02.702216 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e16c8b35-d042-4221-9be6-9fd992c862e3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:02.974035 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-e16c8b35-d042-4221-9be6-9fd992c862e3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:02.994393 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-e16c8b35-d042-4221-9be6-9fd992c862e3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:02.997371 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-e16c8b35-d042-4221-9be6-9fd992c862e3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:02.999722 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-e16c8b35-d042-4221-9be6-9fd992c862e3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1408 microversion: 2.20 time: 0.324682 Aug 24 13:39:03.000819 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 50/95] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:39:02 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1408 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:39:03.154978 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-dfca2450-2c05-410b-938c-59f43da14583 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:03.157023 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-dfca2450-2c05-410b-938c-59f43da14583 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:03.168920 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dfca2450-2c05-410b-938c-59f43da14583 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:03.175245 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dfca2450-2c05-410b-938c-59f43da14583 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:03.175245 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dfca2450-2c05-410b-938c-59f43da14583 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:03.175245 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dfca2450-2c05-410b-938c-59f43da14583 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:03.175245 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dfca2450-2c05-410b-938c-59f43da14583 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:03.175773 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dfca2450-2c05-410b-938c-59f43da14583 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:03.386267 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-dfca2450-2c05-410b-938c-59f43da14583 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:03.399307 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-dfca2450-2c05-410b-938c-59f43da14583 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1314 microversion: 2.1 time: 0.253409 Aug 24 13:39:03.401818 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 46/96] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:03 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:03.556907 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-73ab92a4-80da-4756-a67f-483b51f67778 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:03.559847 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-73ab92a4-80da-4756-a67f-483b51f67778 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:03.588679 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-73ab92a4-80da-4756-a67f-483b51f67778 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:03.591088 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-73ab92a4-80da-4756-a67f-483b51f67778 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:03.592072 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-73ab92a4-80da-4756-a67f-483b51f67778 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:03.594165 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-73ab92a4-80da-4756-a67f-483b51f67778 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:03.595699 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-73ab92a4-80da-4756-a67f-483b51f67778 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:03.597613 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-73ab92a4-80da-4756-a67f-483b51f67778 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:03.876500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-73ab92a4-80da-4756-a67f-483b51f67778 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:03.909922 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-73ab92a4-80da-4756-a67f-483b51f67778 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1366 microversion: 2.1 time: 0.373776 Aug 24 13:39:03.928955 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 51/97] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:03 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1366 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:04.036691 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-0bd75c3d-4184-4dd7-a93b-02b166cddebf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:04.038361 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-0bd75c3d-4184-4dd7-a93b-02b166cddebf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:04.069622 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0bd75c3d-4184-4dd7-a93b-02b166cddebf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:04.075832 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0bd75c3d-4184-4dd7-a93b-02b166cddebf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:04.075832 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0bd75c3d-4184-4dd7-a93b-02b166cddebf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:04.075832 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0bd75c3d-4184-4dd7-a93b-02b166cddebf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:04.075832 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0bd75c3d-4184-4dd7-a93b-02b166cddebf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:04.076663 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0bd75c3d-4184-4dd7-a93b-02b166cddebf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:04.350841 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0bd75c3d-4184-4dd7-a93b-02b166cddebf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:04.371357 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0bd75c3d-4184-4dd7-a93b-02b166cddebf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:04.395692 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0bd75c3d-4184-4dd7-a93b-02b166cddebf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:04.402767 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-0bd75c3d-4184-4dd7-a93b-02b166cddebf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1408 microversion: 2.20 time: 0.379465 Aug 24 13:39:04.406936 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 47/98] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:39:04 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1408 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:39:04.440430 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-806a3c6d-c6e5-474e-b0a0-7bcfde540ae5 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:04.441388 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-806a3c6d-c6e5-474e-b0a0-7bcfde540ae5 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:04.450240 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-806a3c6d-c6e5-474e-b0a0-7bcfde540ae5 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:04.451506 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-806a3c6d-c6e5-474e-b0a0-7bcfde540ae5 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:04.453215 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-806a3c6d-c6e5-474e-b0a0-7bcfde540ae5 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:04.454326 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-806a3c6d-c6e5-474e-b0a0-7bcfde540ae5 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:04.454938 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-806a3c6d-c6e5-474e-b0a0-7bcfde540ae5 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:04.455535 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-806a3c6d-c6e5-474e-b0a0-7bcfde540ae5 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:04.722910 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-806a3c6d-c6e5-474e-b0a0-7bcfde540ae5 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:04.739120 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-806a3c6d-c6e5-474e-b0a0-7bcfde540ae5 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1314 microversion: 2.1 time: 0.305768 Aug 24 13:39:04.760708 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 52/99] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:04 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:04.951587 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a51fc1af-de8e-4bd2-965c-e08ad4026c6d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:04.953698 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a51fc1af-de8e-4bd2-965c-e08ad4026c6d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:04.962996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a51fc1af-de8e-4bd2-965c-e08ad4026c6d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:04.963994 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a51fc1af-de8e-4bd2-965c-e08ad4026c6d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:04.964674 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a51fc1af-de8e-4bd2-965c-e08ad4026c6d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:04.965591 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a51fc1af-de8e-4bd2-965c-e08ad4026c6d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:04.966186 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a51fc1af-de8e-4bd2-965c-e08ad4026c6d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:04.966744 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a51fc1af-de8e-4bd2-965c-e08ad4026c6d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:05.185782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a51fc1af-de8e-4bd2-965c-e08ad4026c6d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:05.201243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a51fc1af-de8e-4bd2-965c-e08ad4026c6d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1366 microversion: 2.1 time: 0.256264 Aug 24 13:39:05.203521 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 48/100] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:04 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:05.442363 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-965a22c0-6883-4d7c-880f-50ac8f40a1c6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:05.442902 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-965a22c0-6883-4d7c-880f-50ac8f40a1c6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:05.449529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-965a22c0-6883-4d7c-880f-50ac8f40a1c6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:05.450024 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-965a22c0-6883-4d7c-880f-50ac8f40a1c6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:05.450466 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-965a22c0-6883-4d7c-880f-50ac8f40a1c6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:05.451187 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-965a22c0-6883-4d7c-880f-50ac8f40a1c6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:05.451648 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-965a22c0-6883-4d7c-880f-50ac8f40a1c6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:05.452084 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-965a22c0-6883-4d7c-880f-50ac8f40a1c6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:05.630730 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-965a22c0-6883-4d7c-880f-50ac8f40a1c6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:05.646321 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-965a22c0-6883-4d7c-880f-50ac8f40a1c6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:05.649217 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-965a22c0-6883-4d7c-880f-50ac8f40a1c6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:05.651455 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-965a22c0-6883-4d7c-880f-50ac8f40a1c6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1408 microversion: 2.20 time: 0.213069 Aug 24 13:39:05.652759 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 53/101] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:39:05 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1408 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:39:05.781579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e4316771-2c67-4568-a71f-7801f776fdd4 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:05.782867 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-e4316771-2c67-4568-a71f-7801f776fdd4 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:05.798501 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e4316771-2c67-4568-a71f-7801f776fdd4 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:05.799679 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e4316771-2c67-4568-a71f-7801f776fdd4 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:05.800560 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e4316771-2c67-4568-a71f-7801f776fdd4 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:05.801934 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e4316771-2c67-4568-a71f-7801f776fdd4 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:05.802800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e4316771-2c67-4568-a71f-7801f776fdd4 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:05.807031 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e4316771-2c67-4568-a71f-7801f776fdd4 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:05.997715 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e4316771-2c67-4568-a71f-7801f776fdd4 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:06.007801 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-e4316771-2c67-4568-a71f-7801f776fdd4 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1314 microversion: 2.1 time: 0.232244 Aug 24 13:39:06.008337 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 49/102] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:05 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:39:06.240623 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-f33eddce-bfd4-4ab4-9bda-59e4f1b20f0e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:06.241817 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-f33eddce-bfd4-4ab4-9bda-59e4f1b20f0e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:06.255871 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f33eddce-bfd4-4ab4-9bda-59e4f1b20f0e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:06.256959 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f33eddce-bfd4-4ab4-9bda-59e4f1b20f0e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:06.257873 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f33eddce-bfd4-4ab4-9bda-59e4f1b20f0e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:06.259236 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f33eddce-bfd4-4ab4-9bda-59e4f1b20f0e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:06.260582 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f33eddce-bfd4-4ab4-9bda-59e4f1b20f0e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:06.264299 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f33eddce-bfd4-4ab4-9bda-59e4f1b20f0e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:06.556494 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f33eddce-bfd4-4ab4-9bda-59e4f1b20f0e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:06.569268 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-f33eddce-bfd4-4ab4-9bda-59e4f1b20f0e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1366 microversion: 2.1 time: 0.336982 Aug 24 13:39:06.570597 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 54/103] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:06 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:06.680120 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-3329f5f4-22a1-41c5-9231-f9e05ec9db03 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:06.682241 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-3329f5f4-22a1-41c5-9231-f9e05ec9db03 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:06.693515 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3329f5f4-22a1-41c5-9231-f9e05ec9db03 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:06.694378 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3329f5f4-22a1-41c5-9231-f9e05ec9db03 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:06.695240 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3329f5f4-22a1-41c5-9231-f9e05ec9db03 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:06.696559 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3329f5f4-22a1-41c5-9231-f9e05ec9db03 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:06.697710 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3329f5f4-22a1-41c5-9231-f9e05ec9db03 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:06.698715 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3329f5f4-22a1-41c5-9231-f9e05ec9db03 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:06.906175 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3329f5f4-22a1-41c5-9231-f9e05ec9db03 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:06.922911 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3329f5f4-22a1-41c5-9231-f9e05ec9db03 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:06.925671 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3329f5f4-22a1-41c5-9231-f9e05ec9db03 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:06.928434 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-3329f5f4-22a1-41c5-9231-f9e05ec9db03 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1408 microversion: 2.20 time: 0.255471 Aug 24 13:39:06.929508 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 50/104] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:39:06 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1408 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:39:07.039885 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-db1ced23-d8db-4594-8fea-03e3098cb43f tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:07.041815 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-db1ced23-d8db-4594-8fea-03e3098cb43f tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:07.056006 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-db1ced23-d8db-4594-8fea-03e3098cb43f tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:07.057241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-db1ced23-d8db-4594-8fea-03e3098cb43f tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:07.058769 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-db1ced23-d8db-4594-8fea-03e3098cb43f tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:07.060620 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-db1ced23-d8db-4594-8fea-03e3098cb43f tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:07.062460 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-db1ced23-d8db-4594-8fea-03e3098cb43f tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:07.063352 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-db1ced23-d8db-4594-8fea-03e3098cb43f tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:07.286918 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-db1ced23-d8db-4594-8fea-03e3098cb43f tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:07.303992 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-db1ced23-d8db-4594-8fea-03e3098cb43f tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1314 microversion: 2.1 time: 0.272258 Aug 24 13:39:07.321163 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 55/105] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:07 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:07.616617 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-6e79a96e-5d2d-43ca-aed4-8c1f65fd7f80 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:07.618056 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-6e79a96e-5d2d-43ca-aed4-8c1f65fd7f80 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:07.627319 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6e79a96e-5d2d-43ca-aed4-8c1f65fd7f80 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:07.628053 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6e79a96e-5d2d-43ca-aed4-8c1f65fd7f80 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:07.629252 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6e79a96e-5d2d-43ca-aed4-8c1f65fd7f80 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:07.630437 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6e79a96e-5d2d-43ca-aed4-8c1f65fd7f80 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:07.631200 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6e79a96e-5d2d-43ca-aed4-8c1f65fd7f80 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:07.632392 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6e79a96e-5d2d-43ca-aed4-8c1f65fd7f80 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:07.900363 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-6e79a96e-5d2d-43ca-aed4-8c1f65fd7f80 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:07.913743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-6e79a96e-5d2d-43ca-aed4-8c1f65fd7f80 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1366 microversion: 2.1 time: 0.311217 Aug 24 13:39:07.917141 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 51/106] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:07 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:07.967109 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-72b18433-dfeb-4df5-8044-4b451e7eb92c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:07.967862 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-72b18433-dfeb-4df5-8044-4b451e7eb92c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:07.975082 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-72b18433-dfeb-4df5-8044-4b451e7eb92c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:07.975894 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-72b18433-dfeb-4df5-8044-4b451e7eb92c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:07.976726 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-72b18433-dfeb-4df5-8044-4b451e7eb92c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:07.977905 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-72b18433-dfeb-4df5-8044-4b451e7eb92c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:07.978460 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-72b18433-dfeb-4df5-8044-4b451e7eb92c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:07.979208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-72b18433-dfeb-4df5-8044-4b451e7eb92c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:08.215297 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-72b18433-dfeb-4df5-8044-4b451e7eb92c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:08.234718 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-72b18433-dfeb-4df5-8044-4b451e7eb92c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:08.236971 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-72b18433-dfeb-4df5-8044-4b451e7eb92c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:08.238257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-72b18433-dfeb-4df5-8044-4b451e7eb92c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1408 microversion: 2.20 time: 0.275309 Aug 24 13:39:08.238861 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 56/107] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:39:07 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1408 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:39:08.346593 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-4570eb76-733c-4274-8ca8-79ea6a8e1064 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:08.347154 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-4570eb76-733c-4274-8ca8-79ea6a8e1064 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:08.357710 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4570eb76-733c-4274-8ca8-79ea6a8e1064 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:08.359127 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4570eb76-733c-4274-8ca8-79ea6a8e1064 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:08.360366 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4570eb76-733c-4274-8ca8-79ea6a8e1064 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:08.361987 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4570eb76-733c-4274-8ca8-79ea6a8e1064 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:08.364415 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4570eb76-733c-4274-8ca8-79ea6a8e1064 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:08.365567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4570eb76-733c-4274-8ca8-79ea6a8e1064 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:08.655851 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-4570eb76-733c-4274-8ca8-79ea6a8e1064 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:08.672285 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-4570eb76-733c-4274-8ca8-79ea6a8e1064 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1314 microversion: 2.1 time: 0.330073 Aug 24 13:39:08.674197 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 52/108] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:08 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:39:08.933869 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-b7050c39-3eac-4152-8496-12ff8f3500b8 req-1d02ff23-6ae1-4222-bc96-679ae53554ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41fef0de-6828-4680-ade1-e4c25d189d6e", "name": "network-vif-plugged", "status": "completed", "tag": "7bc85c4a-d736-4e8a-86bf-61d6911d0812"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:39:08.960112 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a38044fe-bab5-4510-87ca-35f126b5282f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:08.963725 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a38044fe-bab5-4510-87ca-35f126b5282f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:08.966235 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-b7050c39-3eac-4152-8496-12ff8f3500b8 req-1d02ff23-6ae1-4222-bc96-679ae53554ae service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:08.966878 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-b7050c39-3eac-4152-8496-12ff8f3500b8 req-1d02ff23-6ae1-4222-bc96-679ae53554ae service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:08.967518 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-b7050c39-3eac-4152-8496-12ff8f3500b8 req-1d02ff23-6ae1-4222-bc96-679ae53554ae service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:08.974038 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a38044fe-bab5-4510-87ca-35f126b5282f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:08.974782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a38044fe-bab5-4510-87ca-35f126b5282f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:08.975377 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a38044fe-bab5-4510-87ca-35f126b5282f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:08.976464 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a38044fe-bab5-4510-87ca-35f126b5282f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:08.977479 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a38044fe-bab5-4510-87ca-35f126b5282f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:08.978216 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a38044fe-bab5-4510-87ca-35f126b5282f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:09.001995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-b7050c39-3eac-4152-8496-12ff8f3500b8 req-1d02ff23-6ae1-4222-bc96-679ae53554ae service nova] Creating event network-vif-plugged:7bc85c4a-d736-4e8a-86bf-61d6911d0812 for instance 41fef0de-6828-4680-ade1-e4c25d189d6e on hv-cinder-77957 Aug 24 13:39:09.002555 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-b7050c39-3eac-4152-8496-12ff8f3500b8 req-1d02ff23-6ae1-4222-bc96-679ae53554ae service nova] Acquiring lock "compute-rpcapi-router" {{(pid=133015) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 13:39:09.003198 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-b7050c39-3eac-4152-8496-12ff8f3500b8 req-1d02ff23-6ae1-4222-bc96-679ae53554ae service nova] Acquired lock "compute-rpcapi-router" {{(pid=133015) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 13:39:09.005757 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-732d7b61-9c48-4ff5-99b6-967a787b9592 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:09.005757 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-732d7b61-9c48-4ff5-99b6-967a787b9592 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:09.007051 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-732d7b61-9c48-4ff5-99b6-967a787b9592 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:09.008373 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-732d7b61-9c48-4ff5-99b6-967a787b9592 None None] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:09.008843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-732d7b61-9c48-4ff5-99b6-967a787b9592 None None] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:09.009405 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-732d7b61-9c48-4ff5-99b6-967a787b9592 None None] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:09.029201 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.compute.rpcapi [None req-732d7b61-9c48-4ff5-99b6-967a787b9592 None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 13:39:09.031068 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-732d7b61-9c48-4ff5-99b6-967a787b9592 None None] Releasing lock "compute-rpcapi-router" {{(pid=133015) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 13:39:09.095087 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-732d7b61-9c48-4ff5-99b6-967a787b9592 None None] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.305182 Aug 24 13:39:09.101803 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 57/109] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:39:09.274631 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-72446e0c-c19d-409c-a23b-f4802a589014 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:09.281192 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-72446e0c-c19d-409c-a23b-f4802a589014 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:09.293474 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-72446e0c-c19d-409c-a23b-f4802a589014 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:09.294755 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-72446e0c-c19d-409c-a23b-f4802a589014 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:09.295498 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-72446e0c-c19d-409c-a23b-f4802a589014 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:09.299568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-72446e0c-c19d-409c-a23b-f4802a589014 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:09.299568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-72446e0c-c19d-409c-a23b-f4802a589014 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:09.303292 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-72446e0c-c19d-409c-a23b-f4802a589014 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:09.312597 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a38044fe-bab5-4510-87ca-35f126b5282f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:09.334980 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a38044fe-bab5-4510-87ca-35f126b5282f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1366 microversion: 2.1 time: 0.378844 Aug 24 13:39:09.344237 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 53/110] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:08 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1366 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:39:09.541809 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-72446e0c-c19d-409c-a23b-f4802a589014 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:09.562491 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-72446e0c-c19d-409c-a23b-f4802a589014 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:09.567508 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-72446e0c-c19d-409c-a23b-f4802a589014 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:09.570087 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-72446e0c-c19d-409c-a23b-f4802a589014 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1408 microversion: 2.20 time: 0.310021 Aug 24 13:39:09.571849 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 58/111] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:39:09 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1408 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:39:09.716148 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-af85ff4a-edb5-4847-a401-385db16ca1c7 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:09.718005 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-af85ff4a-edb5-4847-a401-385db16ca1c7 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:09.732683 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-af85ff4a-edb5-4847-a401-385db16ca1c7 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:09.734647 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-af85ff4a-edb5-4847-a401-385db16ca1c7 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:09.736335 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-af85ff4a-edb5-4847-a401-385db16ca1c7 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:09.738310 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-af85ff4a-edb5-4847-a401-385db16ca1c7 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:09.743992 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-af85ff4a-edb5-4847-a401-385db16ca1c7 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:09.746359 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-af85ff4a-edb5-4847-a401-385db16ca1c7 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:10.085306 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-af85ff4a-edb5-4847-a401-385db16ca1c7 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:10.099142 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-af85ff4a-edb5-4847-a401-385db16ca1c7 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1314 microversion: 2.1 time: 0.391265 Aug 24 13:39:10.100223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 54/112] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:09 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:10.377373 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-1e5d7971-9488-46cb-8ff4-000ff17b1b67 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:10.379201 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-1e5d7971-9488-46cb-8ff4-000ff17b1b67 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:10.412000 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1e5d7971-9488-46cb-8ff4-000ff17b1b67 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:10.412451 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1e5d7971-9488-46cb-8ff4-000ff17b1b67 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:10.412895 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1e5d7971-9488-46cb-8ff4-000ff17b1b67 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:10.413613 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1e5d7971-9488-46cb-8ff4-000ff17b1b67 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:10.414055 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1e5d7971-9488-46cb-8ff4-000ff17b1b67 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:10.414673 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1e5d7971-9488-46cb-8ff4-000ff17b1b67 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:10.607606 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a7b343e4-1b87-46bf-8f55-27360c6b6ec1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:10.609729 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a7b343e4-1b87-46bf-8f55-27360c6b6ec1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:10.621934 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a7b343e4-1b87-46bf-8f55-27360c6b6ec1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:10.623284 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a7b343e4-1b87-46bf-8f55-27360c6b6ec1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:10.624960 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a7b343e4-1b87-46bf-8f55-27360c6b6ec1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:10.626864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a7b343e4-1b87-46bf-8f55-27360c6b6ec1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:10.628010 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a7b343e4-1b87-46bf-8f55-27360c6b6ec1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:10.629015 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a7b343e4-1b87-46bf-8f55-27360c6b6ec1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:10.662767 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-1e5d7971-9488-46cb-8ff4-000ff17b1b67 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:10.684680 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-1e5d7971-9488-46cb-8ff4-000ff17b1b67 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1366 microversion: 2.1 time: 0.322844 Aug 24 13:39:10.687299 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 59/113] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:10 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:10.867807 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a7b343e4-1b87-46bf-8f55-27360c6b6ec1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:10.886010 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a7b343e4-1b87-46bf-8f55-27360c6b6ec1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:10.889217 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a7b343e4-1b87-46bf-8f55-27360c6b6ec1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:10.892174 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a7b343e4-1b87-46bf-8f55-27360c6b6ec1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1408 microversion: 2.20 time: 0.291281 Aug 24 13:39:10.893438 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 55/114] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:39:10 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1408 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:39:11.122641 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-53f08463-54fd-41ce-826a-36fedc637c81 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:11.123309 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-53f08463-54fd-41ce-826a-36fedc637c81 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:11.135025 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-53f08463-54fd-41ce-826a-36fedc637c81 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:11.135575 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-53f08463-54fd-41ce-826a-36fedc637c81 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:11.136038 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-53f08463-54fd-41ce-826a-36fedc637c81 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:11.138214 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-53f08463-54fd-41ce-826a-36fedc637c81 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:11.138710 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-53f08463-54fd-41ce-826a-36fedc637c81 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:11.139166 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-53f08463-54fd-41ce-826a-36fedc637c81 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:11.145810 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-325e7fe0-5399-4a1d-8ff3-4b6b1afa9bd9 req-cc308dff-ea4b-482a-a919-8ec6b2125ffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53bade32-e7bf-4ace-9b68-0458f257feff", "name": "network-vif-plugged", "status": "completed", "tag": "55484e25-34c8-469b-8598-d718e9469013"}, {"server_uuid": "3ad88e6d-b2b8-4049-b987-94022767fa67", "name": "network-vif-plugged", "status": "completed", "tag": "0723b1a9-9fdc-4151-b023-7ddb25fe09e0"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:39:11.178358 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-325e7fe0-5399-4a1d-8ff3-4b6b1afa9bd9 req-cc308dff-ea4b-482a-a919-8ec6b2125ffd service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:11.179620 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-325e7fe0-5399-4a1d-8ff3-4b6b1afa9bd9 req-cc308dff-ea4b-482a-a919-8ec6b2125ffd service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:11.183429 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-325e7fe0-5399-4a1d-8ff3-4b6b1afa9bd9 req-cc308dff-ea4b-482a-a919-8ec6b2125ffd service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:11.212628 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-325e7fe0-5399-4a1d-8ff3-4b6b1afa9bd9 req-cc308dff-ea4b-482a-a919-8ec6b2125ffd service nova] Creating event network-vif-plugged:55484e25-34c8-469b-8598-d718e9469013 for instance 53bade32-e7bf-4ace-9b68-0458f257feff on hv-cinder-77957 Aug 24 13:39:11.213617 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-325e7fe0-5399-4a1d-8ff3-4b6b1afa9bd9 req-cc308dff-ea4b-482a-a919-8ec6b2125ffd service nova] Creating event network-vif-plugged:0723b1a9-9fdc-4151-b023-7ddb25fe09e0 for instance 3ad88e6d-b2b8-4049-b987-94022767fa67 on hv-cinder-77957 Aug 24 13:39:11.228830 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-325e7fe0-5399-4a1d-8ff3-4b6b1afa9bd9 req-cc308dff-ea4b-482a-a919-8ec6b2125ffd service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.094605 Aug 24 13:39:11.230843 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 56/115] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:39:11.497212 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-53f08463-54fd-41ce-826a-36fedc637c81 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:11.513025 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-53f08463-54fd-41ce-826a-36fedc637c81 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1314 microversion: 2.1 time: 0.394621 Aug 24 13:39:11.516450 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 60/116] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:11 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:39:11.728149 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e7315d8e-e12f-4841-9aa2-3d30bf5abbcc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:11.729448 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-e7315d8e-e12f-4841-9aa2-3d30bf5abbcc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:11.739228 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e7315d8e-e12f-4841-9aa2-3d30bf5abbcc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:11.740213 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e7315d8e-e12f-4841-9aa2-3d30bf5abbcc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:11.740807 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e7315d8e-e12f-4841-9aa2-3d30bf5abbcc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:11.741855 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e7315d8e-e12f-4841-9aa2-3d30bf5abbcc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:11.742571 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e7315d8e-e12f-4841-9aa2-3d30bf5abbcc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:11.743245 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e7315d8e-e12f-4841-9aa2-3d30bf5abbcc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:11.928645 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-ee0b7901-f08f-4a6f-a605-c2c9c6d08956 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:11.932992 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-ee0b7901-f08f-4a6f-a605-c2c9c6d08956 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:11.934792 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e7315d8e-e12f-4841-9aa2-3d30bf5abbcc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:11.948452 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ee0b7901-f08f-4a6f-a605-c2c9c6d08956 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:11.950076 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ee0b7901-f08f-4a6f-a605-c2c9c6d08956 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:11.951865 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ee0b7901-f08f-4a6f-a605-c2c9c6d08956 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:11.954190 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ee0b7901-f08f-4a6f-a605-c2c9c6d08956 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:11.955422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ee0b7901-f08f-4a6f-a605-c2c9c6d08956 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:11.957245 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ee0b7901-f08f-4a6f-a605-c2c9c6d08956 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:11.967289 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-e7315d8e-e12f-4841-9aa2-3d30bf5abbcc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1366 microversion: 2.1 time: 0.235111 Aug 24 13:39:11.967289 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 57/117] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:11 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:11.976857 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=100 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:39:12.137655 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-ee0b7901-f08f-4a6f-a605-c2c9c6d08956 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:12.154664 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-ee0b7901-f08f-4a6f-a605-c2c9c6d08956 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:12.159924 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-ee0b7901-f08f-4a6f-a605-c2c9c6d08956 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:12.162694 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-ee0b7901-f08f-4a6f-a605-c2c9c6d08956 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1408 microversion: 2.20 time: 0.243413 Aug 24 13:39:12.172560 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 61/118] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:39:11 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:39:12.548800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-797f0a2e-c58a-454e-b78b-518a597063a7 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:12.549972 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-797f0a2e-c58a-454e-b78b-518a597063a7 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:12.562222 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-797f0a2e-c58a-454e-b78b-518a597063a7 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:12.563017 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-797f0a2e-c58a-454e-b78b-518a597063a7 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:12.563673 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-797f0a2e-c58a-454e-b78b-518a597063a7 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:12.564677 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-797f0a2e-c58a-454e-b78b-518a597063a7 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:12.565395 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-797f0a2e-c58a-454e-b78b-518a597063a7 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:12.566066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-797f0a2e-c58a-454e-b78b-518a597063a7 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:12.815946 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-797f0a2e-c58a-454e-b78b-518a597063a7 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:12.832215 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-797f0a2e-c58a-454e-b78b-518a597063a7 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1314 microversion: 2.1 time: 0.289727 Aug 24 13:39:12.833051 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 58/119] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:12 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:12.987743 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-15ca01b3-25f9-4908-befa-459b1c3fc9ad tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:12.988949 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-15ca01b3-25f9-4908-befa-459b1c3fc9ad tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:13.000346 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-15ca01b3-25f9-4908-befa-459b1c3fc9ad tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:13.001361 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-15ca01b3-25f9-4908-befa-459b1c3fc9ad tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:13.002206 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-15ca01b3-25f9-4908-befa-459b1c3fc9ad tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:13.003517 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-15ca01b3-25f9-4908-befa-459b1c3fc9ad tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:13.004560 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-15ca01b3-25f9-4908-befa-459b1c3fc9ad tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:13.005398 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-15ca01b3-25f9-4908-befa-459b1c3fc9ad tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:13.211912 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-155e698c-6fcc-441d-aa5f-ba9d559a1d28 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:13.213385 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-155e698c-6fcc-441d-aa5f-ba9d559a1d28 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:13.230399 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-155e698c-6fcc-441d-aa5f-ba9d559a1d28 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:13.231546 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-155e698c-6fcc-441d-aa5f-ba9d559a1d28 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:13.233333 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-155e698c-6fcc-441d-aa5f-ba9d559a1d28 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:13.236364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-155e698c-6fcc-441d-aa5f-ba9d559a1d28 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:13.237646 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-155e698c-6fcc-441d-aa5f-ba9d559a1d28 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:13.238942 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-155e698c-6fcc-441d-aa5f-ba9d559a1d28 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:13.336540 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-15ca01b3-25f9-4908-befa-459b1c3fc9ad tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:13.351188 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-15ca01b3-25f9-4908-befa-459b1c3fc9ad tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1366 microversion: 2.1 time: 0.369367 Aug 24 13:39:13.352825 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 62/120] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:12 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:13.520854 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-155e698c-6fcc-441d-aa5f-ba9d559a1d28 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:13.530740 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-155e698c-6fcc-441d-aa5f-ba9d559a1d28 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:13.532500 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-155e698c-6fcc-441d-aa5f-ba9d559a1d28 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:13.533761 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-155e698c-6fcc-441d-aa5f-ba9d559a1d28 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1408 microversion: 2.20 time: 0.335022 Aug 24 13:39:13.534510 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 59/121] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:39:13 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1408 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:39:13.871478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-7e820713-92f3-4ac7-83f7-9925d2b2595c tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:13.872255 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-7e820713-92f3-4ac7-83f7-9925d2b2595c tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:13.881487 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7e820713-92f3-4ac7-83f7-9925d2b2595c tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:13.882048 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7e820713-92f3-4ac7-83f7-9925d2b2595c tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:13.887710 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7e820713-92f3-4ac7-83f7-9925d2b2595c tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:13.887710 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7e820713-92f3-4ac7-83f7-9925d2b2595c tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:13.887710 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7e820713-92f3-4ac7-83f7-9925d2b2595c tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:13.887710 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7e820713-92f3-4ac7-83f7-9925d2b2595c tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:14.093806 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-7e820713-92f3-4ac7-83f7-9925d2b2595c tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:14.104892 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-7e820713-92f3-4ac7-83f7-9925d2b2595c tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1314 microversion: 2.1 time: 0.238809 Aug 24 13:39:14.105852 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 63/122] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:13 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:14.393564 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-2eba3658-0aa3-461b-9be1-b24305e311ae tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:14.394429 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-2eba3658-0aa3-461b-9be1-b24305e311ae tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:14.403948 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2eba3658-0aa3-461b-9be1-b24305e311ae tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:14.404718 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2eba3658-0aa3-461b-9be1-b24305e311ae tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:14.406248 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2eba3658-0aa3-461b-9be1-b24305e311ae tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:14.407306 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2eba3658-0aa3-461b-9be1-b24305e311ae tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:14.408166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2eba3658-0aa3-461b-9be1-b24305e311ae tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:14.408883 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2eba3658-0aa3-461b-9be1-b24305e311ae tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:14.561057 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-754c8a9b-7ddf-44d0-92d9-de1d728d8779 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:14.562503 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-754c8a9b-7ddf-44d0-92d9-de1d728d8779 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:14.572525 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-754c8a9b-7ddf-44d0-92d9-de1d728d8779 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:14.572525 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-754c8a9b-7ddf-44d0-92d9-de1d728d8779 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:14.572842 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-754c8a9b-7ddf-44d0-92d9-de1d728d8779 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:14.578335 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-754c8a9b-7ddf-44d0-92d9-de1d728d8779 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:14.579521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-754c8a9b-7ddf-44d0-92d9-de1d728d8779 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:14.579969 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-754c8a9b-7ddf-44d0-92d9-de1d728d8779 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:14.763649 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-2eba3658-0aa3-461b-9be1-b24305e311ae tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:14.796522 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=100 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:39:14.796522 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-2eba3658-0aa3-461b-9be1-b24305e311ae tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1366 microversion: 2.1 time: 0.398441 Aug 24 13:39:14.796522 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 60/123] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:14 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1366 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:14.803874 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-754c8a9b-7ddf-44d0-92d9-de1d728d8779 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:14.813717 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-754c8a9b-7ddf-44d0-92d9-de1d728d8779 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:14.815281 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-754c8a9b-7ddf-44d0-92d9-de1d728d8779 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:14.816573 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-754c8a9b-7ddf-44d0-92d9-de1d728d8779 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1408 microversion: 2.20 time: 0.261644 Aug 24 13:39:14.817516 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 64/124] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:39:14 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1408 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:39:15.131258 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-451fe9af-f6a2-438a-b7e5-7c9e4ae0516e tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:15.131906 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-451fe9af-f6a2-438a-b7e5-7c9e4ae0516e tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:15.138605 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-451fe9af-f6a2-438a-b7e5-7c9e4ae0516e tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:15.139358 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-451fe9af-f6a2-438a-b7e5-7c9e4ae0516e tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:15.140523 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-451fe9af-f6a2-438a-b7e5-7c9e4ae0516e tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:15.141315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-451fe9af-f6a2-438a-b7e5-7c9e4ae0516e tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:15.141784 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-451fe9af-f6a2-438a-b7e5-7c9e4ae0516e tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:15.142213 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-451fe9af-f6a2-438a-b7e5-7c9e4ae0516e tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:15.351541 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-451fe9af-f6a2-438a-b7e5-7c9e4ae0516e tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:15.369827 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-451fe9af-f6a2-438a-b7e5-7c9e4ae0516e tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1314 microversion: 2.1 time: 0.242466 Aug 24 13:39:15.370948 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 61/125] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:15 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:39:15.820950 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d194f9ce-3d8c-45aa-81e8-399cecbd2f46 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:15.822283 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-d194f9ce-3d8c-45aa-81e8-399cecbd2f46 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:15.852517 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-0d0c985b-1632-43ad-a2b3-b22645abb7bb tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:15.852517 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-0d0c985b-1632-43ad-a2b3-b22645abb7bb tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:15.853614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d194f9ce-3d8c-45aa-81e8-399cecbd2f46 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:15.853614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d194f9ce-3d8c-45aa-81e8-399cecbd2f46 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:15.853614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d194f9ce-3d8c-45aa-81e8-399cecbd2f46 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:15.854130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d194f9ce-3d8c-45aa-81e8-399cecbd2f46 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:15.855298 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d194f9ce-3d8c-45aa-81e8-399cecbd2f46 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:15.857012 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d194f9ce-3d8c-45aa-81e8-399cecbd2f46 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:15.868407 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0d0c985b-1632-43ad-a2b3-b22645abb7bb tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:15.877788 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0d0c985b-1632-43ad-a2b3-b22645abb7bb tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:15.877788 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0d0c985b-1632-43ad-a2b3-b22645abb7bb tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:15.877788 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0d0c985b-1632-43ad-a2b3-b22645abb7bb tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:15.881510 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0d0c985b-1632-43ad-a2b3-b22645abb7bb tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:15.885855 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0d0c985b-1632-43ad-a2b3-b22645abb7bb tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:16.409000 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d194f9ce-3d8c-45aa-81e8-399cecbd2f46 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:16.424687 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-d194f9ce-3d8c-45aa-81e8-399cecbd2f46 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1366 microversion: 2.1 time: 0.616313 Aug 24 13:39:16.426966 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 65/126] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:15 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1366 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:16.438729 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-73634c95-2556-415c-9492-35cb44251a41 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:16.440036 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-73634c95-2556-415c-9492-35cb44251a41 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:16.467746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-73634c95-2556-415c-9492-35cb44251a41 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:16.469372 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-73634c95-2556-415c-9492-35cb44251a41 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:16.472213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-73634c95-2556-415c-9492-35cb44251a41 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:16.476352 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-73634c95-2556-415c-9492-35cb44251a41 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:16.477931 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-73634c95-2556-415c-9492-35cb44251a41 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:16.478700 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-73634c95-2556-415c-9492-35cb44251a41 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:16.509093 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0d0c985b-1632-43ad-a2b3-b22645abb7bb tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:16.534029 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0d0c985b-1632-43ad-a2b3-b22645abb7bb tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:16.537023 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0d0c985b-1632-43ad-a2b3-b22645abb7bb tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:16.548998 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-0d0c985b-1632-43ad-a2b3-b22645abb7bb tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1408 microversion: 2.20 time: 0.709169 Aug 24 13:39:16.556905 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 62/127] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:39:15 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1408 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:39:16.771351 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-73634c95-2556-415c-9492-35cb44251a41 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:16.789461 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-73634c95-2556-415c-9492-35cb44251a41 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1500 microversion: 2.1 time: 0.360404 Aug 24 13:39:16.790524 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 66/128] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:16 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1500 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:17.464036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-3ccbac43-7914-45d2-b494-8162692874d8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:17.465081 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-3ccbac43-7914-45d2-b494-8162692874d8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:17.490455 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3ccbac43-7914-45d2-b494-8162692874d8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:17.491812 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3ccbac43-7914-45d2-b494-8162692874d8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:17.493632 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3ccbac43-7914-45d2-b494-8162692874d8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:17.495140 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3ccbac43-7914-45d2-b494-8162692874d8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:17.495978 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3ccbac43-7914-45d2-b494-8162692874d8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:17.496925 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3ccbac43-7914-45d2-b494-8162692874d8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:17.590463 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-e2e8e994-180f-476a-88df-0248f83b5a4e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:17.590463 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-e2e8e994-180f-476a-88df-0248f83b5a4e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:17.619980 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e2e8e994-180f-476a-88df-0248f83b5a4e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:17.620526 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e2e8e994-180f-476a-88df-0248f83b5a4e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:17.621558 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e2e8e994-180f-476a-88df-0248f83b5a4e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:17.623263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e2e8e994-180f-476a-88df-0248f83b5a4e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:17.624970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e2e8e994-180f-476a-88df-0248f83b5a4e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:17.625998 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e2e8e994-180f-476a-88df-0248f83b5a4e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:17.866289 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3ccbac43-7914-45d2-b494-8162692874d8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:17.876274 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-3ccbac43-7914-45d2-b494-8162692874d8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1366 microversion: 2.1 time: 0.416732 Aug 24 13:39:17.877447 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 63/129] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:17 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1366 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:18.012226 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-e2e8e994-180f-476a-88df-0248f83b5a4e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:18.035943 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-e2e8e994-180f-476a-88df-0248f83b5a4e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:18.039317 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-e2e8e994-180f-476a-88df-0248f83b5a4e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:18.043368 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-e2e8e994-180f-476a-88df-0248f83b5a4e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1601 microversion: 2.20 time: 0.469266 Aug 24 13:39:18.044945 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 67/130] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:39:17 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1601 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:39:18.088836 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-eead4613-d101-4e52-b2da-15349364ade5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:18.089335 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-eead4613-d101-4e52-b2da-15349364ade5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:18.100563 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eead4613-d101-4e52-b2da-15349364ade5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:18.101085 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eead4613-d101-4e52-b2da-15349364ade5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:18.105293 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eead4613-d101-4e52-b2da-15349364ade5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:18.106166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eead4613-d101-4e52-b2da-15349364ade5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:18.106656 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eead4613-d101-4e52-b2da-15349364ade5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:18.107094 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eead4613-d101-4e52-b2da-15349364ade5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:18.319560 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-eead4613-d101-4e52-b2da-15349364ade5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.234346 Aug 24 13:39:18.320978 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 64/131] 10.222.0.73 () {60 vars in 1316 bytes} [Wed Aug 24 13:39:18 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff/os-interface => generated 285 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 13:39:18.903879 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d0084d57-3bb4-4ed3-876a-63f0ab9047b1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:18.908354 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-d0084d57-3bb4-4ed3-876a-63f0ab9047b1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:18.922725 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d0084d57-3bb4-4ed3-876a-63f0ab9047b1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:18.923531 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d0084d57-3bb4-4ed3-876a-63f0ab9047b1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:18.924273 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d0084d57-3bb4-4ed3-876a-63f0ab9047b1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:18.925465 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d0084d57-3bb4-4ed3-876a-63f0ab9047b1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:18.934259 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d0084d57-3bb4-4ed3-876a-63f0ab9047b1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:18.935376 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d0084d57-3bb4-4ed3-876a-63f0ab9047b1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:19.020053 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=2 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:39:19.177584 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d0084d57-3bb4-4ed3-876a-63f0ab9047b1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:19.188954 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-d0084d57-3bb4-4ed3-876a-63f0ab9047b1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1557 microversion: 2.1 time: 0.292292 Aug 24 13:39:19.189734 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 68/132] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:18 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1557 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:19.237523 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-bb11b042-af65-4b03-8f71-3a51d27295be tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:19.239064 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-bb11b042-af65-4b03-8f71-3a51d27295be tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:19.247633 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bb11b042-af65-4b03-8f71-3a51d27295be tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:19.249437 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bb11b042-af65-4b03-8f71-3a51d27295be tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:19.250302 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bb11b042-af65-4b03-8f71-3a51d27295be tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:19.253726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bb11b042-af65-4b03-8f71-3a51d27295be tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:19.254522 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bb11b042-af65-4b03-8f71-3a51d27295be tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:19.260788 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bb11b042-af65-4b03-8f71-3a51d27295be tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:19.494914 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-bb11b042-af65-4b03-8f71-3a51d27295be tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.266719 Aug 24 13:39:19.496092 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 65/133] 10.222.0.73 () {58 vars in 1275 bytes} [Wed Aug 24 13:39:19 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-interface => generated 285 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:39:19.587530 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-7eea1149-750b-4be9-b49c-54c65e904d28 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8991746b-7c17-4c03-910d-5ccab7214a2b"}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:39:19.593963 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-7eea1149-750b-4be9-b49c-54c65e904d28 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:19.602399 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7eea1149-750b-4be9-b49c-54c65e904d28 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:19.603319 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7eea1149-750b-4be9-b49c-54c65e904d28 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:19.604008 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7eea1149-750b-4be9-b49c-54c65e904d28 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:19.605051 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7eea1149-750b-4be9-b49c-54c65e904d28 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:19.605756 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7eea1149-750b-4be9-b49c-54c65e904d28 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:19.606404 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7eea1149-750b-4be9-b49c-54c65e904d28 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:21.066928 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-020782cd-efd3-4e88-80f6-071b66fa7418 req-319d9006-c9f3-406b-93d5-3477a731f1b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53bade32-e7bf-4ace-9b68-0458f257feff", "tag": "55484e25-34c8-469b-8598-d718e9469013"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:39:21.081580 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-020782cd-efd3-4e88-80f6-071b66fa7418 req-319d9006-c9f3-406b-93d5-3477a731f1b1 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:21.082076 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-020782cd-efd3-4e88-80f6-071b66fa7418 req-319d9006-c9f3-406b-93d5-3477a731f1b1 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:21.082519 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-020782cd-efd3-4e88-80f6-071b66fa7418 req-319d9006-c9f3-406b-93d5-3477a731f1b1 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:21.102740 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-020782cd-efd3-4e88-80f6-071b66fa7418 req-319d9006-c9f3-406b-93d5-3477a731f1b1 service nova] Creating event network-changed:55484e25-34c8-469b-8598-d718e9469013 for instance 53bade32-e7bf-4ace-9b68-0458f257feff on hv-cinder-77957 Aug 24 13:39:21.106351 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-020782cd-efd3-4e88-80f6-071b66fa7418 req-319d9006-c9f3-406b-93d5-3477a731f1b1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049644 Aug 24 13:39:21.112160 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 66/134] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:39:21.155869 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-7eea1149-750b-4be9-b49c-54c65e904d28 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "POST /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.572832 Aug 24 13:39:21.158770 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 69/135] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 13:39:19 2022] POST /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e/os-volume_attachments => generated 194 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:39:22.471167 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-8ba96d0b-d198-40c1-bfa5-8c0aaaad7359 req-a9694fa3-f0c9-4a02-9561-ac8d9f4ff082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ad88e6d-b2b8-4049-b987-94022767fa67", "tag": "0723b1a9-9fdc-4151-b023-7ddb25fe09e0"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:39:22.490005 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-8ba96d0b-d198-40c1-bfa5-8c0aaaad7359 req-a9694fa3-f0c9-4a02-9561-ac8d9f4ff082 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:22.490521 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-8ba96d0b-d198-40c1-bfa5-8c0aaaad7359 req-a9694fa3-f0c9-4a02-9561-ac8d9f4ff082 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:22.490962 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-8ba96d0b-d198-40c1-bfa5-8c0aaaad7359 req-a9694fa3-f0c9-4a02-9561-ac8d9f4ff082 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:22.519643 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-8ba96d0b-d198-40c1-bfa5-8c0aaaad7359 req-a9694fa3-f0c9-4a02-9561-ac8d9f4ff082 service nova] Creating event network-changed:0723b1a9-9fdc-4151-b023-7ddb25fe09e0 for instance 3ad88e6d-b2b8-4049-b987-94022767fa67 on hv-cinder-77957 Aug 24 13:39:22.534103 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-8ba96d0b-d198-40c1-bfa5-8c0aaaad7359 req-a9694fa3-f0c9-4a02-9561-ac8d9f4ff082 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068346 Aug 24 13:39:22.546921 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 67/136] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:39:46.234742 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_api:SELECT=46 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:39:46.236343 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:39:46.241601 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-9c8c5e9d-12f0-4ec6-b1eb-1133f4ad36a3 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:46.242738 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-9c8c5e9d-12f0-4ec6-b1eb-1133f4ad36a3 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:46.252699 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9c8c5e9d-12f0-4ec6-b1eb-1133f4ad36a3 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:46.253242 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9c8c5e9d-12f0-4ec6-b1eb-1133f4ad36a3 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:46.254964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9c8c5e9d-12f0-4ec6-b1eb-1133f4ad36a3 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:46.256245 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9c8c5e9d-12f0-4ec6-b1eb-1133f4ad36a3 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:46.256245 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9c8c5e9d-12f0-4ec6-b1eb-1133f4ad36a3 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:46.256626 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9c8c5e9d-12f0-4ec6-b1eb-1133f4ad36a3 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:46.283154 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-9c8c5e9d-12f0-4ec6-b1eb-1133f4ad36a3 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Going to try to terminate instance {{(pid=133015) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 13:39:46.637256 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-9c8c5e9d-12f0-4ec6-b1eb-1133f4ad36a3 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "DELETE /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 204 len: 0 microversion: 2.1 time: 0.406032 Aug 24 13:39:46.637843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 70/137] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:39:46 2022] DELETE /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:39:46.647118 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-35ca27e1-14f8-4345-8be1-c7e1a4c4153a tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:46.648545 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-35ca27e1-14f8-4345-8be1-c7e1a4c4153a tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:46.650867 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_api:SELECT=68 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:39:46.651583 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=30 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:39:46.658095 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-35ca27e1-14f8-4345-8be1-c7e1a4c4153a tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:46.658990 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-35ca27e1-14f8-4345-8be1-c7e1a4c4153a tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:46.659124 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-35ca27e1-14f8-4345-8be1-c7e1a4c4153a tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:46.659741 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-35ca27e1-14f8-4345-8be1-c7e1a4c4153a tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:46.660340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-35ca27e1-14f8-4345-8be1-c7e1a4c4153a tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:46.660771 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-35ca27e1-14f8-4345-8be1-c7e1a4c4153a tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:46.816535 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-35ca27e1-14f8-4345-8be1-c7e1a4c4153a tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:46.830656 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-35ca27e1-14f8-4345-8be1-c7e1a4c4153a tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1552 microversion: 2.1 time: 0.187536 Aug 24 13:39:46.831465 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 68/138] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:46 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1552 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:47.853534 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-2b8c1643-e3d8-4e49-9c3f-ba41718468d0 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:47.854239 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-2b8c1643-e3d8-4e49-9c3f-ba41718468d0 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:47.865126 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2b8c1643-e3d8-4e49-9c3f-ba41718468d0 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:47.868823 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2b8c1643-e3d8-4e49-9c3f-ba41718468d0 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:47.868823 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2b8c1643-e3d8-4e49-9c3f-ba41718468d0 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:47.868823 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2b8c1643-e3d8-4e49-9c3f-ba41718468d0 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:47.868823 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2b8c1643-e3d8-4e49-9c3f-ba41718468d0 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:47.869400 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2b8c1643-e3d8-4e49-9c3f-ba41718468d0 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:48.019806 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2b8c1643-e3d8-4e49-9c3f-ba41718468d0 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:48.030332 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-2b8c1643-e3d8-4e49-9c3f-ba41718468d0 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1552 microversion: 2.1 time: 0.181001 Aug 24 13:39:48.030929 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 71/139] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:47 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1552 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:49.059462 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-d851d847-791e-46a4-b4a3-4f376e4eeb58 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:49.061214 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-d851d847-791e-46a4-b4a3-4f376e4eeb58 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:49.068076 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d851d847-791e-46a4-b4a3-4f376e4eeb58 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:49.069036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d851d847-791e-46a4-b4a3-4f376e4eeb58 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:49.069637 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d851d847-791e-46a4-b4a3-4f376e4eeb58 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:49.070374 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d851d847-791e-46a4-b4a3-4f376e4eeb58 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:49.071200 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d851d847-791e-46a4-b4a3-4f376e4eeb58 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:49.071625 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d851d847-791e-46a4-b4a3-4f376e4eeb58 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:49.264983 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-d851d847-791e-46a4-b4a3-4f376e4eeb58 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:49.273818 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-d851d847-791e-46a4-b4a3-4f376e4eeb58 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1552 microversion: 2.1 time: 0.220479 Aug 24 13:39:49.275239 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 69/140] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:49 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1552 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:49.935094 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-21d22847-7058-4463-8285-4be32047782c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-996671296", "imageRef": "c520113c-3dae-4490-98bb-19fe3a46b66d", "flavorRef": "452", "networks": [{"uuid": "c0c5540c-3e08-475c-a808-3a64025a5c41"}]}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:39:49.995029 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.network.neutron [None req-21d22847-7058-4463-8285-4be32047782c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] validate_networks() for [('c0c5540c-3e08-475c-a808-3a64025a5c41', None, None, None, None, None)] {{(pid=133015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:39:50.299007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-0fc9466e-2c56-4eae-a62b-3a5c5adb6bf4 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:50.300425 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-0fc9466e-2c56-4eae-a62b-3a5c5adb6bf4 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:50.307489 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0fc9466e-2c56-4eae-a62b-3a5c5adb6bf4 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:50.308650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0fc9466e-2c56-4eae-a62b-3a5c5adb6bf4 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:50.309377 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0fc9466e-2c56-4eae-a62b-3a5c5adb6bf4 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:50.310214 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0fc9466e-2c56-4eae-a62b-3a5c5adb6bf4 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:50.311435 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0fc9466e-2c56-4eae-a62b-3a5c5adb6bf4 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:50.312580 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0fc9466e-2c56-4eae-a62b-3a5c5adb6bf4 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:50.445149 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-21d22847-7058-4463-8285-4be32047782c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Flavor limits 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:39:50.445653 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-21d22847-7058-4463-8285-4be32047782c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Image limits 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:39:50.446181 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-21d22847-7058-4463-8285-4be32047782c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Flavor pref 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:39:50.446651 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-21d22847-7058-4463-8285-4be32047782c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Image pref 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:39:50.447125 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-21d22847-7058-4463-8285-4be32047782c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:39:50.456922 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-21d22847-7058-4463-8285-4be32047782c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:50.457476 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-21d22847-7058-4463-8285-4be32047782c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:50.457974 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-21d22847-7058-4463-8285-4be32047782c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:50.458854 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-21d22847-7058-4463-8285-4be32047782c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:50.459404 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-21d22847-7058-4463-8285-4be32047782c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:50.459818 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-21d22847-7058-4463-8285-4be32047782c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:50.476926 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-21d22847-7058-4463-8285-4be32047782c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Getting quotas for project c22fb394e99345d88b2e082b22902af3. Resources: {'instances', 'cores', 'ram'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:39:50.481788 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-21d22847-7058-4463-8285-4be32047782c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Getting quotas for user e9c7ecfdb9904095b122bb8fd82121fe and project c22fb394e99345d88b2e082b22902af3. Resources: {'instances', 'cores', 'ram'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:39:50.493751 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0fc9466e-2c56-4eae-a62b-3a5c5adb6bf4 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:50.494743 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-21d22847-7058-4463-8285-4be32047782c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Going to run 1 instances... {{(pid=133015) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 13:39:50.497256 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-21d22847-7058-4463-8285-4be32047782c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 7ae14fa1-f847-426c-82dd-2a6c76107b75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c520113c-3dae-4490-98bb-19fe3a46b66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 13:39:50.504349 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-0fc9466e-2c56-4eae-a62b-3a5c5adb6bf4 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1552 microversion: 2.1 time: 0.211306 Aug 24 13:39:50.504999 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 70/141] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:50 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1552 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:39:50.620458 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-21d22847-7058-4463-8285-4be32047782c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.689398 Aug 24 13:39:50.628402 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 72/142] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 13:39:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 13:39:50.633443 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-8ad5aca3-7f2d-414e-bdac-a80988655d6d tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:50.634386 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-8ad5aca3-7f2d-414e-bdac-a80988655d6d tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 7ae14fa1-f847-426c-82dd-2a6c76107b75] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:50.701961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-8ad5aca3-7f2d-414e-bdac-a80988655d6d tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:50.711243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-8ad5aca3-7f2d-414e-bdac-a80988655d6d tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75" status: 200 len: 1213 microversion: 2.1 time: 0.081901 Aug 24 13:39:50.712908 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 71/143] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:50 2022] GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:39:51.526616 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-c4dd5015-88f5-4b9d-aa47-e57f9d19202b req-ea4d41cb-2af2-4a00-98d6-7b1d7bb2b110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41fef0de-6828-4680-ade1-e4c25d189d6e", "name": "network-vif-deleted", "tag": "7bc85c4a-d736-4e8a-86bf-61d6911d0812"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:39:51.535754 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d06deaa3-337e-43bc-b7fc-e94123239858 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:51.537081 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-d06deaa3-337e-43bc-b7fc-e94123239858 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:51.544886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-c4dd5015-88f5-4b9d-aa47-e57f9d19202b req-ea4d41cb-2af2-4a00-98d6-7b1d7bb2b110 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:51.545482 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-c4dd5015-88f5-4b9d-aa47-e57f9d19202b req-ea4d41cb-2af2-4a00-98d6-7b1d7bb2b110 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:51.549267 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-c4dd5015-88f5-4b9d-aa47-e57f9d19202b req-ea4d41cb-2af2-4a00-98d6-7b1d7bb2b110 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:51.568886 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d06deaa3-337e-43bc-b7fc-e94123239858 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:51.569397 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d06deaa3-337e-43bc-b7fc-e94123239858 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:51.569843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d06deaa3-337e-43bc-b7fc-e94123239858 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:51.571551 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-c4dd5015-88f5-4b9d-aa47-e57f9d19202b req-ea4d41cb-2af2-4a00-98d6-7b1d7bb2b110 service nova] Creating event network-vif-deleted:7bc85c4a-d736-4e8a-86bf-61d6911d0812 for instance 41fef0de-6828-4680-ade1-e4c25d189d6e on hv-cinder-77957 Aug 24 13:39:51.575987 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d06deaa3-337e-43bc-b7fc-e94123239858 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:51.575987 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d06deaa3-337e-43bc-b7fc-e94123239858 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:51.575987 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d06deaa3-337e-43bc-b7fc-e94123239858 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:51.579345 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-c4dd5015-88f5-4b9d-aa47-e57f9d19202b req-ea4d41cb-2af2-4a00-98d6-7b1d7bb2b110 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056563 Aug 24 13:39:51.585880 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 72/144] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:39:51.665673 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d06deaa3-337e-43bc-b7fc-e94123239858 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:51.686125 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-d06deaa3-337e-43bc-b7fc-e94123239858 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1510 microversion: 2.1 time: 0.157077 Aug 24 13:39:51.687054 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 73/145] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:51 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:51.734492 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-30c6b996-0cae-484b-a82e-296ae9087e6e tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:51.735576 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-30c6b996-0cae-484b-a82e-296ae9087e6e tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 7ae14fa1-f847-426c-82dd-2a6c76107b75] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:51.840880 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-30c6b996-0cae-484b-a82e-296ae9087e6e tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:51.863614 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-30c6b996-0cae-484b-a82e-296ae9087e6e tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75" status: 200 len: 1213 microversion: 2.1 time: 0.134024 Aug 24 13:39:51.864832 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 73/146] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:51 2022] GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75 => generated 1213 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:52.719594 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-decb9d17-0791-4fb8-af41-27aebbe1d5a8 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:52.720852 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-decb9d17-0791-4fb8-af41-27aebbe1d5a8 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:52.726978 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-decb9d17-0791-4fb8-af41-27aebbe1d5a8 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:52.727482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-decb9d17-0791-4fb8-af41-27aebbe1d5a8 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:52.727867 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-decb9d17-0791-4fb8-af41-27aebbe1d5a8 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:52.728654 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-decb9d17-0791-4fb8-af41-27aebbe1d5a8 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:52.729049 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-decb9d17-0791-4fb8-af41-27aebbe1d5a8 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:52.729461 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-decb9d17-0791-4fb8-af41-27aebbe1d5a8 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:52.766257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-decb9d17-0791-4fb8-af41-27aebbe1d5a8 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:52.766740 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-decb9d17-0791-4fb8-af41-27aebbe1d5a8 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:52.767178 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-decb9d17-0791-4fb8-af41-27aebbe1d5a8 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:52.767634 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.objects.instance [None req-decb9d17-0791-4fb8-af41-27aebbe1d5a8 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lazy-loading 'fault' on Instance uuid 41fef0de-6828-4680-ade1-e4c25d189d6e {{(pid=133015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:39:52.819717 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-decb9d17-0791-4fb8-af41-27aebbe1d5a8 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0108005591b14c5081d460f5c1a7526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b5eebd2706440badffd858826d5c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:52.831436 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-decb9d17-0791-4fb8-af41-27aebbe1d5a8 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 200 len: 1350 microversion: 2.1 time: 0.117453 Aug 24 13:39:52.832377 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 74/147] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:52 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 1350 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:52.895659 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-76bd6961-2c09-4c3a-8945-68584948c500 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:52.896302 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-76bd6961-2c09-4c3a-8945-68584948c500 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 7ae14fa1-f847-426c-82dd-2a6c76107b75] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:52.902879 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-76bd6961-2c09-4c3a-8945-68584948c500 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:52.903564 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-76bd6961-2c09-4c3a-8945-68584948c500 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:52.904004 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-76bd6961-2c09-4c3a-8945-68584948c500 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:52.904879 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-76bd6961-2c09-4c3a-8945-68584948c500 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:52.906061 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-76bd6961-2c09-4c3a-8945-68584948c500 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:52.906830 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-76bd6961-2c09-4c3a-8945-68584948c500 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:52.975430 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-76bd6961-2c09-4c3a-8945-68584948c500 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:52.983588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-76bd6961-2c09-4c3a-8945-68584948c500 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75" status: 200 len: 1217 microversion: 2.1 time: 0.091669 Aug 24 13:39:52.984473 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 74/148] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:52 2022] GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75 => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:53.862964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-4119a09b-92f5-49a4-a65a-73fd2537bfbd tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:53.863612 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-4119a09b-92f5-49a4-a65a-73fd2537bfbd tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:53.872541 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4119a09b-92f5-49a4-a65a-73fd2537bfbd tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:53.873228 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4119a09b-92f5-49a4-a65a-73fd2537bfbd tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:53.873670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4119a09b-92f5-49a4-a65a-73fd2537bfbd tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:53.874555 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4119a09b-92f5-49a4-a65a-73fd2537bfbd tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:53.875269 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4119a09b-92f5-49a4-a65a-73fd2537bfbd tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:53.875880 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4119a09b-92f5-49a4-a65a-73fd2537bfbd tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:53.895012 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.wsgi [None req-4119a09b-92f5-49a4-a65a-73fd2537bfbd tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] HTTP exception thrown: Instance 41fef0de-6828-4680-ade1-e4c25d189d6e could not be found. Aug 24 13:39:53.916073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-4119a09b-92f5-49a4-a65a-73fd2537bfbd tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Request method failure captured: Aug 24 13:39:53.916073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e HTTP/1.1 Aug 24 13:39:53.916073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:39:53.916073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:39:53.916073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:39:53.916073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 0 Aug 24 13:39:53.916073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:39:53.916073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:39:53.916073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:39:53.916073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:39:53.916073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBinT0ihBI-kbNASkEyjIuw5wB5hnIuPLRekmWjkWDQnPQ_mbTF8WUh1Kt3QJbiN3sxTSaqAEgIwMELOrJu1_yBAxAgxTMZDCxtABaF1yPmvhdENtlvMzpPb9qB3aam3_0AI-UPo406MC_4By52J655RbbyYM7weeCJeZ7NW4xzlf2hE Aug 24 13:39:53.916073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:39:53.916073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:39:53.916073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:39:53.916073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:39:53.916073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:39:53.916073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:39:53.916073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: 77b5eebd2706440badffd858826d5c79 Aug 24 13:39:53.916073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-DeleteServersTestJSON-1726506434 Aug 24 13:39:53.916073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:39:53.916073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:39:53.917585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/77b5eebd2706440badffd858826d5c79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/77b5eebd2706440badffd858826d5c79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_77b5eebd2706440badffd858826d5c79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/77b5eebd2706440badffd858826d5c79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:39:53.917585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-DeleteServersTestJSON-1726506434 Aug 24 13:39:53.917585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: 77b5eebd2706440badffd858826d5c79 Aug 24 13:39:53.917585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-DeleteServersTestJSON-1726506434 Aug 24 13:39:53.917585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-DeleteServersTestJSON-1726506434-project Aug 24 13:39:53.917585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:39:53.917585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:39:53.917585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: 0108005591b14c5081d460f5c1a7526f Aug 24 13:39:53.917585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-DeleteServersTestJSON-1726506434-project Aug 24 13:39:53.917585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: > Aug 24 13:39:53.917585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Instance 41fef0de-6828-4680-ade1-e4c25d189d6e could not be found. Aug 24 13:39:53.917585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'id': '41fef0de-6828-4680-ade1-e4c25d189d6e'} Aug 24 13:39:53.918392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:39:53.918392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:39:53.918392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:39:53.918392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:39:53.918392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:39:53.918392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:39:53.918392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:39:53.918392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:39:53.918392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:39:53.918392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:39:53.918392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41fef0de-6828-4680-ade1-e4c25d189d6e could not be found. Aug 24 13:39:53.918392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:39:53.918392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:39:53.918392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:39:53.918392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:39:53.918392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:39:53.918392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:39:53.918392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:39:53.918392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:39:53.918392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:39:53.919683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:39:53.919683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:39:53.919683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:39:53.919683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:39:53.919683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:39:53.919683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:39:53.919683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:39:53.919683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41fef0de-6828-4680-ade1-e4c25d189d6e could not be found. Aug 24 13:39:53.919683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:39:53.919683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:39:53.919683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:39:53.919683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:39:53.919683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:39:53.919683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:39:53.919683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:39:53.919683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:39:53.919683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41fef0de-6828-4680-ade1-e4c25d189d6e could not be found. Aug 24 13:39:53.919683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:39:53.922577 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-4119a09b-92f5-49a4-a65a-73fd2537bfbd tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Returning 404 to user: Instance 41fef0de-6828-4680-ade1-e4c25d189d6e could not be found. {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:39:53.922577 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-4119a09b-92f5-49a4-a65a-73fd2537bfbd tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 404 len: 111 microversion: 2.1 time: 0.063547 Aug 24 13:39:53.922577 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 75/149] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:53 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:39:54.013659 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-42dc36cb-7f6c-4f60-af91-7171c32d2a10 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:54.017324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-42dc36cb-7f6c-4f60-af91-7171c32d2a10 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 7ae14fa1-f847-426c-82dd-2a6c76107b75] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:54.025911 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-42dc36cb-7f6c-4f60-af91-7171c32d2a10 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:54.028317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-42dc36cb-7f6c-4f60-af91-7171c32d2a10 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:54.029651 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-42dc36cb-7f6c-4f60-af91-7171c32d2a10 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:54.031435 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-42dc36cb-7f6c-4f60-af91-7171c32d2a10 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:54.032120 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-42dc36cb-7f6c-4f60-af91-7171c32d2a10 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:54.032727 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-42dc36cb-7f6c-4f60-af91-7171c32d2a10 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:54.254654 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-42dc36cb-7f6c-4f60-af91-7171c32d2a10 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:54.254654 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-42dc36cb-7f6c-4f60-af91-7171c32d2a10 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75" status: 200 len: 1273 microversion: 2.1 time: 0.111323 Aug 24 13:39:54.254654 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 75/150] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:54 2022] GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75 => generated 1273 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:54.278716 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-7ca04abe-d474-49cb-aa7c-bd651588c97b tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:54.281187 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-7ca04abe-d474-49cb-aa7c-bd651588c97b tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:54.287422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7ca04abe-d474-49cb-aa7c-bd651588c97b tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:54.287908 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7ca04abe-d474-49cb-aa7c-bd651588c97b tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:54.288370 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7ca04abe-d474-49cb-aa7c-bd651588c97b tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:54.289060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7ca04abe-d474-49cb-aa7c-bd651588c97b tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:54.289512 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7ca04abe-d474-49cb-aa7c-bd651588c97b tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:54.289920 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7ca04abe-d474-49cb-aa7c-bd651588c97b tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:54.304609 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.wsgi [None req-7ca04abe-d474-49cb-aa7c-bd651588c97b tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] HTTP exception thrown: Instance 41fef0de-6828-4680-ade1-e4c25d189d6e could not be found. Aug 24 13:39:54.312771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-7ca04abe-d474-49cb-aa7c-bd651588c97b tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Request method failure captured: Aug 24 13:39:54.312771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e/os-volume_attachments HTTP/1.1 Aug 24 13:39:54.312771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:39:54.312771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:39:54.312771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:39:54.312771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 0 Aug 24 13:39:54.312771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:39:54.312771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:39:54.312771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:39:54.312771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:39:54.312771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBinT0ihBI-kbNASkEyjIuw5wB5hnIuPLRekmWjkWDQnPQ_mbTF8WUh1Kt3QJbiN3sxTSaqAEgIwMELOrJu1_yBAxAgxTMZDCxtABaF1yPmvhdENtlvMzpPb9qB3aam3_0AI-UPo406MC_4By52J655RbbyYM7weeCJeZ7NW4xzlf2hE Aug 24 13:39:54.312771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:39:54.312771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:39:54.312771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:39:54.312771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:39:54.312771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:39:54.312771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:39:54.312771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: 77b5eebd2706440badffd858826d5c79 Aug 24 13:39:54.312771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-DeleteServersTestJSON-1726506434 Aug 24 13:39:54.312771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:39:54.312771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:39:54.314248 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/77b5eebd2706440badffd858826d5c79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/77b5eebd2706440badffd858826d5c79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_77b5eebd2706440badffd858826d5c79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/77b5eebd2706440badffd858826d5c79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:39:54.314248 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-DeleteServersTestJSON-1726506434 Aug 24 13:39:54.314248 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: 77b5eebd2706440badffd858826d5c79 Aug 24 13:39:54.314248 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-DeleteServersTestJSON-1726506434 Aug 24 13:39:54.314248 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-DeleteServersTestJSON-1726506434-project Aug 24 13:39:54.314248 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:39:54.314248 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:39:54.314248 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: 0108005591b14c5081d460f5c1a7526f Aug 24 13:39:54.314248 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-DeleteServersTestJSON-1726506434-project Aug 24 13:39:54.314248 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: > Aug 24 13:39:54.314248 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Instance 41fef0de-6828-4680-ade1-e4c25d189d6e could not be found. Aug 24 13:39:54.314248 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'server_id': '41fef0de-6828-4680-ade1-e4c25d189d6e'} Aug 24 13:39:54.315060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:39:54.315060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:39:54.315060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:39:54.315060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:39:54.315060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:39:54.315060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:39:54.315060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:39:54.315060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:39:54.315060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:39:54.315060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:39:54.315060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41fef0de-6828-4680-ade1-e4c25d189d6e could not be found. Aug 24 13:39:54.315060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:39:54.315060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:39:54.315060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:39:54.315060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:39:54.315060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:39:54.315060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:39:54.315060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:39:54.315060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:39:54.315060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:39:54.316527 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:39:54.316527 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 13:39:54.316527 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 13:39:54.316527 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 13:39:54.316527 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 13:39:54.316527 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 13:39:54.316527 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 13:39:54.316527 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:39:54.316527 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:39:54.316527 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41fef0de-6828-4680-ade1-e4c25d189d6e could not be found. Aug 24 13:39:54.316527 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:39:54.316527 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:39:54.316527 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:39:54.316527 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:39:54.316527 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:39:54.316527 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:39:54.316527 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:39:54.316527 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:39:54.316527 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41fef0de-6828-4680-ade1-e4c25d189d6e could not be found. Aug 24 13:39:54.316527 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:39:54.317850 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-7ca04abe-d474-49cb-aa7c-bd651588c97b tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Returning 404 to user: Instance 41fef0de-6828-4680-ade1-e4c25d189d6e could not be found. {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:39:54.317850 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-7ca04abe-d474-49cb-aa7c-bd651588c97b tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040050 Aug 24 13:39:54.317850 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 76/151] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:39:54 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:39:55.277627 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-55dbfcde-d638-4e8c-9c3d-4a598af63256 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:55.279515 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-55dbfcde-d638-4e8c-9c3d-4a598af63256 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 7ae14fa1-f847-426c-82dd-2a6c76107b75] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:55.297180 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-55dbfcde-d638-4e8c-9c3d-4a598af63256 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:55.297829 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-55dbfcde-d638-4e8c-9c3d-4a598af63256 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:55.298278 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-55dbfcde-d638-4e8c-9c3d-4a598af63256 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:55.299008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-55dbfcde-d638-4e8c-9c3d-4a598af63256 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:55.299471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-55dbfcde-d638-4e8c-9c3d-4a598af63256 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:55.299955 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-55dbfcde-d638-4e8c-9c3d-4a598af63256 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:55.499452 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-55dbfcde-d638-4e8c-9c3d-4a598af63256 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:55.509404 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-55dbfcde-d638-4e8c-9c3d-4a598af63256 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75" status: 200 len: 1313 microversion: 2.1 time: 0.236591 Aug 24 13:39:55.509998 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 76/152] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:55 2022] GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:55.800946 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-68df5696-3037-4c3c-a660-be10f1697b3d tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:55.802296 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-68df5696-3037-4c3c-a660-be10f1697b3d tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:55.813920 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-68df5696-3037-4c3c-a660-be10f1697b3d tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:55.815090 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-68df5696-3037-4c3c-a660-be10f1697b3d tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:55.815797 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-68df5696-3037-4c3c-a660-be10f1697b3d tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:55.816863 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-68df5696-3037-4c3c-a660-be10f1697b3d tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:55.817389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-68df5696-3037-4c3c-a660-be10f1697b3d tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:55.818010 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-68df5696-3037-4c3c-a660-be10f1697b3d tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:55.834297 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.wsgi [None req-68df5696-3037-4c3c-a660-be10f1697b3d tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] HTTP exception thrown: Instance 41fef0de-6828-4680-ade1-e4c25d189d6e could not be found. Aug 24 13:39:55.836608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-68df5696-3037-4c3c-a660-be10f1697b3d tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Request method failure captured: Aug 24 13:39:55.836608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: DELETE /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e HTTP/1.1 Aug 24 13:39:55.836608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:39:55.836608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:39:55.836608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:39:55.836608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 0 Aug 24 13:39:55.836608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:39:55.836608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:39:55.836608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:39:55.836608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:39:55.836608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBinT0ihBI-kbNASkEyjIuw5wB5hnIuPLRekmWjkWDQnPQ_mbTF8WUh1Kt3QJbiN3sxTSaqAEgIwMELOrJu1_yBAxAgxTMZDCxtABaF1yPmvhdENtlvMzpPb9qB3aam3_0AI-UPo406MC_4By52J655RbbyYM7weeCJeZ7NW4xzlf2hE Aug 24 13:39:55.836608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:39:55.836608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:39:55.836608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:39:55.836608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:39:55.836608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:39:55.836608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:39:55.836608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: 77b5eebd2706440badffd858826d5c79 Aug 24 13:39:55.836608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-DeleteServersTestJSON-1726506434 Aug 24 13:39:55.836608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:39:55.836608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:39:55.837770 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/77b5eebd2706440badffd858826d5c79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/77b5eebd2706440badffd858826d5c79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_77b5eebd2706440badffd858826d5c79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/77b5eebd2706440badffd858826d5c79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:39:55.837770 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-DeleteServersTestJSON-1726506434 Aug 24 13:39:55.837770 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: 77b5eebd2706440badffd858826d5c79 Aug 24 13:39:55.837770 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-DeleteServersTestJSON-1726506434 Aug 24 13:39:55.837770 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-DeleteServersTestJSON-1726506434-project Aug 24 13:39:55.837770 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:39:55.837770 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:39:55.837770 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: 0108005591b14c5081d460f5c1a7526f Aug 24 13:39:55.837770 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-DeleteServersTestJSON-1726506434-project Aug 24 13:39:55.837770 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: > Aug 24 13:39:55.837770 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Instance 41fef0de-6828-4680-ade1-e4c25d189d6e could not be found. Aug 24 13:39:55.837770 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'id': '41fef0de-6828-4680-ade1-e4c25d189d6e'} Aug 24 13:39:55.838482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:39:55.838482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:39:55.838482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:39:55.838482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:39:55.838482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:39:55.838482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:39:55.838482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:39:55.838482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:39:55.838482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:39:55.838482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:39:55.838482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41fef0de-6828-4680-ade1-e4c25d189d6e could not be found. Aug 24 13:39:55.838482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:39:55.838482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:39:55.838482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:39:55.838482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:39:55.838482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:39:55.838482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:39:55.838482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:39:55.838482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:39:55.838482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:39:55.839553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:39:55.839553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 13:39:55.839553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 13:39:55.839553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 13:39:55.839553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 13:39:55.839553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:39:55.839553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:39:55.839553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:39:55.839553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:39:55.839553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41fef0de-6828-4680-ade1-e4c25d189d6e could not be found. Aug 24 13:39:55.839553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:39:55.839553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:39:55.839553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:39:55.839553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:39:55.839553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:39:55.839553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:39:55.839553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:39:55.839553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:39:55.839553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41fef0de-6828-4680-ade1-e4c25d189d6e could not be found. Aug 24 13:39:55.839553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:39:55.842341 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-68df5696-3037-4c3c-a660-be10f1697b3d tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Returning 404 to user: Instance 41fef0de-6828-4680-ade1-e4c25d189d6e could not be found. {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:39:55.844377 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-68df5696-3037-4c3c-a660-be10f1697b3d tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "DELETE /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 404 len: 111 microversion: 2.1 time: 0.048328 Aug 24 13:39:55.845130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 77/153] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:39:55 2022] DELETE /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:39:55.853897 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-3675508c-8f35-4167-bbdd-fa4a57a19526 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:55.856278 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-3675508c-8f35-4167-bbdd-fa4a57a19526 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] [instance: 41fef0de-6828-4680-ade1-e4c25d189d6e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:55.862059 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3675508c-8f35-4167-bbdd-fa4a57a19526 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:55.862555 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3675508c-8f35-4167-bbdd-fa4a57a19526 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:55.863072 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3675508c-8f35-4167-bbdd-fa4a57a19526 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:55.863767 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3675508c-8f35-4167-bbdd-fa4a57a19526 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:55.864475 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3675508c-8f35-4167-bbdd-fa4a57a19526 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:55.865061 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3675508c-8f35-4167-bbdd-fa4a57a19526 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:55.881043 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-3675508c-8f35-4167-bbdd-fa4a57a19526 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] HTTP exception thrown: Instance 41fef0de-6828-4680-ade1-e4c25d189d6e could not be found. Aug 24 13:39:55.885757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-3675508c-8f35-4167-bbdd-fa4a57a19526 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Request method failure captured: Aug 24 13:39:55.885757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e HTTP/1.1 Aug 24 13:39:55.885757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:39:55.885757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:39:55.885757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:39:55.885757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:39:55.885757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:39:55.885757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:39:55.885757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:39:55.885757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:39:55.885757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBinT0ihBI-kbNASkEyjIuw5wB5hnIuPLRekmWjkWDQnPQ_mbTF8WUh1Kt3QJbiN3sxTSaqAEgIwMELOrJu1_yBAxAgxTMZDCxtABaF1yPmvhdENtlvMzpPb9qB3aam3_0AI-UPo406MC_4By52J655RbbyYM7weeCJeZ7NW4xzlf2hE Aug 24 13:39:55.885757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:39:55.885757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:39:55.885757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:39:55.885757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:39:55.885757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:39:55.885757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:39:55.885757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 77b5eebd2706440badffd858826d5c79 Aug 24 13:39:55.885757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-DeleteServersTestJSON-1726506434 Aug 24 13:39:55.885757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:39:55.885757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:39:55.887104 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/77b5eebd2706440badffd858826d5c79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/77b5eebd2706440badffd858826d5c79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_77b5eebd2706440badffd858826d5c79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/77b5eebd2706440badffd858826d5c79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:39:55.887104 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-DeleteServersTestJSON-1726506434 Aug 24 13:39:55.887104 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 77b5eebd2706440badffd858826d5c79 Aug 24 13:39:55.887104 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-DeleteServersTestJSON-1726506434 Aug 24 13:39:55.887104 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-DeleteServersTestJSON-1726506434-project Aug 24 13:39:55.887104 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:39:55.887104 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:39:55.887104 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: 0108005591b14c5081d460f5c1a7526f Aug 24 13:39:55.887104 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-DeleteServersTestJSON-1726506434-project Aug 24 13:39:55.887104 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:39:55.887104 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Instance 41fef0de-6828-4680-ade1-e4c25d189d6e could not be found. Aug 24 13:39:55.887104 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': '41fef0de-6828-4680-ade1-e4c25d189d6e'} Aug 24 13:39:55.887785 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:39:55.887785 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:39:55.887785 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:39:55.887785 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:39:55.887785 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:39:55.887785 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:39:55.887785 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:39:55.887785 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:39:55.887785 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:39:55.887785 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:39:55.887785 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41fef0de-6828-4680-ade1-e4c25d189d6e could not be found. Aug 24 13:39:55.887785 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:39:55.887785 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:39:55.887785 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:39:55.887785 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:39:55.887785 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:39:55.887785 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:39:55.887785 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:39:55.887785 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:39:55.887785 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:39:55.890153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:39:55.890153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:39:55.890153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:39:55.890153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:39:55.890153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:39:55.890153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:39:55.890153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:39:55.890153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41fef0de-6828-4680-ade1-e4c25d189d6e could not be found. Aug 24 13:39:55.890153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:39:55.890153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:39:55.890153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:39:55.890153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:39:55.890153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:39:55.890153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:39:55.890153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:39:55.890153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:39:55.890153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41fef0de-6828-4680-ade1-e4c25d189d6e could not be found. Aug 24 13:39:55.890153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:39:55.891315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-3675508c-8f35-4167-bbdd-fa4a57a19526 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] Returning 404 to user: Instance 41fef0de-6828-4680-ade1-e4c25d189d6e could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:39:55.891315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-3675508c-8f35-4167-bbdd-fa4a57a19526 tempest-DeleteServersTestJSON-1726506434 tempest-DeleteServersTestJSON-1726506434-project] 10.222.0.73 "GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e" status: 404 len: 111 microversion: 2.1 time: 0.037629 Aug 24 13:39:55.891315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 77/154] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:55 2022] GET /compute/v2.1/servers/41fef0de-6828-4680-ade1-e4c25d189d6e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 13:39:56.221004 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-e131343e-d9be-404a-afaf-dfd46e4910a7 req-5f749ca3-ff74-43dc-8c8f-ff695668f579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ae14fa1-f847-426c-82dd-2a6c76107b75", "tag": "50e41dde-e99c-4eee-8a5c-700ebbc96525"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:39:56.236845 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-e131343e-d9be-404a-afaf-dfd46e4910a7 req-5f749ca3-ff74-43dc-8c8f-ff695668f579 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:56.240561 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-e131343e-d9be-404a-afaf-dfd46e4910a7 req-5f749ca3-ff74-43dc-8c8f-ff695668f579 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:56.242146 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-e131343e-d9be-404a-afaf-dfd46e4910a7 req-5f749ca3-ff74-43dc-8c8f-ff695668f579 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:56.268675 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-e131343e-d9be-404a-afaf-dfd46e4910a7 req-5f749ca3-ff74-43dc-8c8f-ff695668f579 service nova] Creating event network-changed:50e41dde-e99c-4eee-8a5c-700ebbc96525 for instance 7ae14fa1-f847-426c-82dd-2a6c76107b75 on hv-cinder-77957 Aug 24 13:39:56.297195 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-e131343e-d9be-404a-afaf-dfd46e4910a7 req-5f749ca3-ff74-43dc-8c8f-ff695668f579 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079635 Aug 24 13:39:56.311124 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 78/155] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:39:56.533585 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-3844968d-0092-46d9-ba20-3871e0efbdea tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:56.534740 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-3844968d-0092-46d9-ba20-3871e0efbdea tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 7ae14fa1-f847-426c-82dd-2a6c76107b75] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:56.556367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3844968d-0092-46d9-ba20-3871e0efbdea tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:56.556367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3844968d-0092-46d9-ba20-3871e0efbdea tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:56.556367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3844968d-0092-46d9-ba20-3871e0efbdea tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:56.556367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3844968d-0092-46d9-ba20-3871e0efbdea tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:56.556657 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3844968d-0092-46d9-ba20-3871e0efbdea tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:56.556657 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3844968d-0092-46d9-ba20-3871e0efbdea tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:56.949696 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3844968d-0092-46d9-ba20-3871e0efbdea tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:56.950843 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-3844968d-0092-46d9-ba20-3871e0efbdea tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75" status: 200 len: 1313 microversion: 2.1 time: 0.423388 Aug 24 13:39:56.952900 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 78/156] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:56 2022] GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75 => generated 1313 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:57.990231 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-4ebf1bcc-2893-49ec-b492-227f0cddb7b4 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:57.992996 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-4ebf1bcc-2893-49ec-b492-227f0cddb7b4 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 7ae14fa1-f847-426c-82dd-2a6c76107b75] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:58.024279 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4ebf1bcc-2893-49ec-b492-227f0cddb7b4 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:58.025259 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4ebf1bcc-2893-49ec-b492-227f0cddb7b4 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:58.026031 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4ebf1bcc-2893-49ec-b492-227f0cddb7b4 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:58.027162 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4ebf1bcc-2893-49ec-b492-227f0cddb7b4 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:58.028167 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4ebf1bcc-2893-49ec-b492-227f0cddb7b4 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:58.029064 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4ebf1bcc-2893-49ec-b492-227f0cddb7b4 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:58.444063 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4ebf1bcc-2893-49ec-b492-227f0cddb7b4 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:58.455379 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-4ebf1bcc-2893-49ec-b492-227f0cddb7b4 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75" status: 200 len: 1313 microversion: 2.1 time: 0.483661 Aug 24 13:39:58.456455 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 79/157] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:57 2022] GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75 => generated 1313 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:39:59.496567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-c5679a2d-f88c-4384-9f61-c38fb168bc43 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:39:59.499720 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-c5679a2d-f88c-4384-9f61-c38fb168bc43 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 7ae14fa1-f847-426c-82dd-2a6c76107b75] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:39:59.508679 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c5679a2d-f88c-4384-9f61-c38fb168bc43 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:59.510337 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c5679a2d-f88c-4384-9f61-c38fb168bc43 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:59.510337 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c5679a2d-f88c-4384-9f61-c38fb168bc43 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:59.511816 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c5679a2d-f88c-4384-9f61-c38fb168bc43 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:39:59.512578 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c5679a2d-f88c-4384-9f61-c38fb168bc43 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:39:59.513311 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c5679a2d-f88c-4384-9f61-c38fb168bc43 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:39:59.738163 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-c5679a2d-f88c-4384-9f61-c38fb168bc43 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:39:59.761774 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-c5679a2d-f88c-4384-9f61-c38fb168bc43 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75" status: 200 len: 1313 microversion: 2.1 time: 0.272614 Aug 24 13:39:59.762365 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 79/158] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:39:59 2022] GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:00.787628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-9fdde61c-ebef-4259-8e61-5788cb630848 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:00.788599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-9fdde61c-ebef-4259-8e61-5788cb630848 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 7ae14fa1-f847-426c-82dd-2a6c76107b75] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:00.791034 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=2 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:40:00.792529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=6 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:40:00.799134 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9fdde61c-ebef-4259-8e61-5788cb630848 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:00.799848 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9fdde61c-ebef-4259-8e61-5788cb630848 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:00.800720 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9fdde61c-ebef-4259-8e61-5788cb630848 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:00.801473 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9fdde61c-ebef-4259-8e61-5788cb630848 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:00.802888 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9fdde61c-ebef-4259-8e61-5788cb630848 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:00.803385 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9fdde61c-ebef-4259-8e61-5788cb630848 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:01.042806 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-9fdde61c-ebef-4259-8e61-5788cb630848 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:01.054773 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-9fdde61c-ebef-4259-8e61-5788cb630848 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75" status: 200 len: 1313 microversion: 2.1 time: 0.274242 Aug 24 13:40:01.072350 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 80/159] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:00 2022] GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:02.076513 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-ea2ced0e-df40-44cf-877b-b925351f2d68 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:02.077763 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-ea2ced0e-df40-44cf-877b-b925351f2d68 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 7ae14fa1-f847-426c-82dd-2a6c76107b75] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:02.083523 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=4 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:40:02.088872 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ea2ced0e-df40-44cf-877b-b925351f2d68 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:02.088872 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ea2ced0e-df40-44cf-877b-b925351f2d68 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:02.088872 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ea2ced0e-df40-44cf-877b-b925351f2d68 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:02.088872 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ea2ced0e-df40-44cf-877b-b925351f2d68 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:02.089375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ea2ced0e-df40-44cf-877b-b925351f2d68 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:02.089794 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ea2ced0e-df40-44cf-877b-b925351f2d68 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:02.294900 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-ea2ced0e-df40-44cf-877b-b925351f2d68 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:02.310663 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-ea2ced0e-df40-44cf-877b-b925351f2d68 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75" status: 200 len: 1313 microversion: 2.1 time: 0.237823 Aug 24 13:40:02.311770 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 80/160] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:02 2022] GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:03.339657 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-c61a0458-ca35-4c59-9382-bef82e2820ee tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:03.340435 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-c61a0458-ca35-4c59-9382-bef82e2820ee tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 7ae14fa1-f847-426c-82dd-2a6c76107b75] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:03.347935 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c61a0458-ca35-4c59-9382-bef82e2820ee tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:03.352441 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c61a0458-ca35-4c59-9382-bef82e2820ee tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:03.352441 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c61a0458-ca35-4c59-9382-bef82e2820ee tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:03.352441 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c61a0458-ca35-4c59-9382-bef82e2820ee tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:03.352441 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c61a0458-ca35-4c59-9382-bef82e2820ee tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:03.352762 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c61a0458-ca35-4c59-9382-bef82e2820ee tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:03.514309 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c61a0458-ca35-4c59-9382-bef82e2820ee tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:03.537685 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-c61a0458-ca35-4c59-9382-bef82e2820ee tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75" status: 200 len: 1313 microversion: 2.1 time: 0.208989 Aug 24 13:40:03.538749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 81/161] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:03 2022] GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:04.573393 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-699e597d-7873-4edd-bc92-d937c390d097 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:04.574786 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-699e597d-7873-4edd-bc92-d937c390d097 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 7ae14fa1-f847-426c-82dd-2a6c76107b75] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:04.600832 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-699e597d-7873-4edd-bc92-d937c390d097 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:04.601881 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-699e597d-7873-4edd-bc92-d937c390d097 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:04.602499 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-699e597d-7873-4edd-bc92-d937c390d097 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:04.603430 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-699e597d-7873-4edd-bc92-d937c390d097 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:04.605713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-699e597d-7873-4edd-bc92-d937c390d097 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:04.609176 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-699e597d-7873-4edd-bc92-d937c390d097 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:04.623221 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-cd7cbfc8-c161-4d54-84de-cf5092c6c46e req-7a88e29d-8500-42d8-9129-4d2cb93a4e0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae14fa1-f847-426c-82dd-2a6c76107b75", "name": "network-vif-plugged", "status": "completed", "tag": "50e41dde-e99c-4eee-8a5c-700ebbc96525"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:40:04.645671 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-cd7cbfc8-c161-4d54-84de-cf5092c6c46e req-7a88e29d-8500-42d8-9129-4d2cb93a4e0f service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:04.646159 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-cd7cbfc8-c161-4d54-84de-cf5092c6c46e req-7a88e29d-8500-42d8-9129-4d2cb93a4e0f service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:04.646590 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-cd7cbfc8-c161-4d54-84de-cf5092c6c46e req-7a88e29d-8500-42d8-9129-4d2cb93a4e0f service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:04.666645 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-cd7cbfc8-c161-4d54-84de-cf5092c6c46e req-7a88e29d-8500-42d8-9129-4d2cb93a4e0f service nova] Creating event network-vif-plugged:50e41dde-e99c-4eee-8a5c-700ebbc96525 for instance 7ae14fa1-f847-426c-82dd-2a6c76107b75 on hv-cinder-77957 Aug 24 13:40:04.676991 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-cd7cbfc8-c161-4d54-84de-cf5092c6c46e req-7a88e29d-8500-42d8-9129-4d2cb93a4e0f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061882 Aug 24 13:40:04.677720 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 82/162] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:40:04.896686 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-699e597d-7873-4edd-bc92-d937c390d097 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:04.906525 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-699e597d-7873-4edd-bc92-d937c390d097 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75" status: 200 len: 1313 microversion: 2.1 time: 0.347848 Aug 24 13:40:04.923136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 81/163] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:04 2022] GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75 => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:05.929921 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b5653658-2802-42cb-9360-31fec795e0e6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:05.931311 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b5653658-2802-42cb-9360-31fec795e0e6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 7ae14fa1-f847-426c-82dd-2a6c76107b75] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:05.943134 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b5653658-2802-42cb-9360-31fec795e0e6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:05.943134 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b5653658-2802-42cb-9360-31fec795e0e6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:05.943134 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b5653658-2802-42cb-9360-31fec795e0e6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:05.943134 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b5653658-2802-42cb-9360-31fec795e0e6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:05.943799 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b5653658-2802-42cb-9360-31fec795e0e6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:05.943799 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b5653658-2802-42cb-9360-31fec795e0e6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:06.106094 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b5653658-2802-42cb-9360-31fec795e0e6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:06.116216 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b5653658-2802-42cb-9360-31fec795e0e6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75" status: 200 len: 1313 microversion: 2.1 time: 0.190873 Aug 24 13:40:06.116794 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 83/164] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:05 2022] GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:06.557329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-9cad8338-771e-4324-a8ac-a2b56c117678 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:06.557872 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-9cad8338-771e-4324-a8ac-a2b56c117678 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:06.565928 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9cad8338-771e-4324-a8ac-a2b56c117678 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:06.571983 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9cad8338-771e-4324-a8ac-a2b56c117678 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:06.571983 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9cad8338-771e-4324-a8ac-a2b56c117678 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:06.571983 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9cad8338-771e-4324-a8ac-a2b56c117678 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:06.571983 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9cad8338-771e-4324-a8ac-a2b56c117678 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:06.572383 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9cad8338-771e-4324-a8ac-a2b56c117678 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:06.594405 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-9cad8338-771e-4324-a8ac-a2b56c117678 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff/ips" status: 200 len: 152 microversion: 2.20 time: 0.041158 Aug 24 13:40:06.595030 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 82/165] 10.222.0.73 () {60 vars in 1289 bytes} [Wed Aug 24 13:40:06 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 13:40:07.141343 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-579e187d-854b-44c4-a640-6a663add8398 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:07.142832 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-579e187d-854b-44c4-a640-6a663add8398 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 7ae14fa1-f847-426c-82dd-2a6c76107b75] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:07.152149 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-579e187d-854b-44c4-a640-6a663add8398 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:07.155677 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-579e187d-854b-44c4-a640-6a663add8398 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:07.155677 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-579e187d-854b-44c4-a640-6a663add8398 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:07.155677 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-579e187d-854b-44c4-a640-6a663add8398 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:07.155677 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-579e187d-854b-44c4-a640-6a663add8398 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:07.156250 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-579e187d-854b-44c4-a640-6a663add8398 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:07.453864 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-579e187d-854b-44c4-a640-6a663add8398 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:07.463002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-579e187d-854b-44c4-a640-6a663add8398 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75" status: 200 len: 1313 microversion: 2.1 time: 0.327939 Aug 24 13:40:07.465114 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 84/166] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:07 2022] GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75 => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:08.511614 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-d8677fae-74c6-440f-85ee-87124b3ae097 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:08.512282 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-d8677fae-74c6-440f-85ee-87124b3ae097 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 7ae14fa1-f847-426c-82dd-2a6c76107b75] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:08.520157 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d8677fae-74c6-440f-85ee-87124b3ae097 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:08.520684 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d8677fae-74c6-440f-85ee-87124b3ae097 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:08.521122 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d8677fae-74c6-440f-85ee-87124b3ae097 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:08.521822 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d8677fae-74c6-440f-85ee-87124b3ae097 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:08.522280 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d8677fae-74c6-440f-85ee-87124b3ae097 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:08.522702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d8677fae-74c6-440f-85ee-87124b3ae097 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:08.707658 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-d8677fae-74c6-440f-85ee-87124b3ae097 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:08.716913 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-d8677fae-74c6-440f-85ee-87124b3ae097 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75" status: 200 len: 1497 microversion: 2.1 time: 0.211771 Aug 24 13:40:08.718286 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 83/167] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:08 2022] GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75 => generated 1497 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:40:09.489119 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a82a1451-3884-4f24-b6f7-19572defe779 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:40:09.490686 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-a82a1451-3884-4f24-b6f7-19572defe779 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:09.522287 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a82a1451-3884-4f24-b6f7-19572defe779 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:09.523234 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a82a1451-3884-4f24-b6f7-19572defe779 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:09.523949 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a82a1451-3884-4f24-b6f7-19572defe779 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:09.524756 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a82a1451-3884-4f24-b6f7-19572defe779 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:09.525357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a82a1451-3884-4f24-b6f7-19572defe779 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:09.538020 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a82a1451-3884-4f24-b6f7-19572defe779 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:09.565255 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.objects.instance [None req-a82a1451-3884-4f24-b6f7-19572defe779 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lazy-loading 'flavor' on Instance uuid 53bade32-e7bf-4ace-9b68-0458f257feff {{(pid=133015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:40:09.726509 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-cc2b8abe-7769-4fb1-bcbc-79dca25e5b70 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:09.727138 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-cc2b8abe-7769-4fb1-bcbc-79dca25e5b70 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:09.750877 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cc2b8abe-7769-4fb1-bcbc-79dca25e5b70 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:09.750877 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cc2b8abe-7769-4fb1-bcbc-79dca25e5b70 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:09.750877 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cc2b8abe-7769-4fb1-bcbc-79dca25e5b70 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:09.750877 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cc2b8abe-7769-4fb1-bcbc-79dca25e5b70 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:09.752016 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cc2b8abe-7769-4fb1-bcbc-79dca25e5b70 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:09.752572 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cc2b8abe-7769-4fb1-bcbc-79dca25e5b70 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:09.794083 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-cc2b8abe-7769-4fb1-bcbc-79dca25e5b70 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/ips" status: 200 len: 150 microversion: 2.1 time: 0.073024 Aug 24 13:40:09.795093 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 84/168] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 13:40:09 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/ips => generated 150 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:40:10.119864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-0a32d2fc-c99b-4c91-be61-4b71a4c8741c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:10.120057 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-0a32d2fc-c99b-4c91-be61-4b71a4c8741c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 7ae14fa1-f847-426c-82dd-2a6c76107b75] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:10.143467 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0a32d2fc-c99b-4c91-be61-4b71a4c8741c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:10.145935 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0a32d2fc-c99b-4c91-be61-4b71a4c8741c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:10.147196 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0a32d2fc-c99b-4c91-be61-4b71a4c8741c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:10.148788 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0a32d2fc-c99b-4c91-be61-4b71a4c8741c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:10.151133 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0a32d2fc-c99b-4c91-be61-4b71a4c8741c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:10.151951 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0a32d2fc-c99b-4c91-be61-4b71a4c8741c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:10.197148 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-0a32d2fc-c99b-4c91-be61-4b71a4c8741c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 7ae14fa1-f847-426c-82dd-2a6c76107b75] Going to try to terminate instance {{(pid=133014) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 13:40:10.491553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a82a1451-3884-4f24-b6f7-19572defe779 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "POST /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff/action" status: 202 len: 0 microversion: 2.20 time: 1.013700 Aug 24 13:40:10.493524 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 85/169] 10.222.0.73 () {62 vars in 1319 bytes} [Wed Aug 24 13:40:09 2022] POST /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff/action => generated 0 bytes in 1018 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:40:10.510293 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-23f23639-3761-4124-a50f-7ae9202fb29a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:10.512318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-23f23639-3761-4124-a50f-7ae9202fb29a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:10.577512 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-23f23639-3761-4124-a50f-7ae9202fb29a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:10.578261 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-23f23639-3761-4124-a50f-7ae9202fb29a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:10.581260 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-23f23639-3761-4124-a50f-7ae9202fb29a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:10.584901 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-23f23639-3761-4124-a50f-7ae9202fb29a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:10.595572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-23f23639-3761-4124-a50f-7ae9202fb29a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:10.597442 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-23f23639-3761-4124-a50f-7ae9202fb29a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:10.648421 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-0a32d2fc-c99b-4c91-be61-4b71a4c8741c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75" status: 204 len: 0 microversion: 2.1 time: 0.538050 Aug 24 13:40:10.651217 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 85/170] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:40:10 2022] DELETE /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:40:10.662326 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-8f30eeda-d7d8-4706-98cb-e08dde62ef01 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:10.663286 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-8f30eeda-d7d8-4706-98cb-e08dde62ef01 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 7ae14fa1-f847-426c-82dd-2a6c76107b75] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:10.672715 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:40:10.673687 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8f30eeda-d7d8-4706-98cb-e08dde62ef01 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:10.677399 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8f30eeda-d7d8-4706-98cb-e08dde62ef01 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:10.677399 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8f30eeda-d7d8-4706-98cb-e08dde62ef01 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:10.677399 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8f30eeda-d7d8-4706-98cb-e08dde62ef01 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:10.677399 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8f30eeda-d7d8-4706-98cb-e08dde62ef01 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:10.677781 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8f30eeda-d7d8-4706-98cb-e08dde62ef01 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:10.953011 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-23f23639-3761-4124-a50f-7ae9202fb29a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:10.964587 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-23f23639-3761-4124-a50f-7ae9202fb29a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:10.970201 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-23f23639-3761-4124-a50f-7ae9202fb29a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:10.973678 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-23f23639-3761-4124-a50f-7ae9202fb29a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1725 microversion: 2.20 time: 0.472372 Aug 24 13:40:10.978488 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 86/171] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:10 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1725 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:10.988408 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-8f30eeda-d7d8-4706-98cb-e08dde62ef01 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:10.994267 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:40:11.007498 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-8f30eeda-d7d8-4706-98cb-e08dde62ef01 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75" status: 200 len: 1503 microversion: 2.1 time: 0.350130 Aug 24 13:40:11.008411 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 86/172] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:10 2022] GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75 => generated 1503 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:12.012402 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-8d1bbed5-ca95-4dfb-8f7c-cfb3eec24b98 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:12.013652 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-8d1bbed5-ca95-4dfb-8f7c-cfb3eec24b98 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:12.023315 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8d1bbed5-ca95-4dfb-8f7c-cfb3eec24b98 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:12.024032 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8d1bbed5-ca95-4dfb-8f7c-cfb3eec24b98 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:12.024503 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8d1bbed5-ca95-4dfb-8f7c-cfb3eec24b98 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:12.025360 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8d1bbed5-ca95-4dfb-8f7c-cfb3eec24b98 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:12.035770 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-7aa70f3f-e8ab-48ba-8ece-9b9aa09619e5 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:12.037059 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-7aa70f3f-e8ab-48ba-8ece-9b9aa09619e5 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 7ae14fa1-f847-426c-82dd-2a6c76107b75] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:12.041325 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8d1bbed5-ca95-4dfb-8f7c-cfb3eec24b98 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:12.042537 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8d1bbed5-ca95-4dfb-8f7c-cfb3eec24b98 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:12.053960 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7aa70f3f-e8ab-48ba-8ece-9b9aa09619e5 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:12.055069 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7aa70f3f-e8ab-48ba-8ece-9b9aa09619e5 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:12.056466 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7aa70f3f-e8ab-48ba-8ece-9b9aa09619e5 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:12.061832 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7aa70f3f-e8ab-48ba-8ece-9b9aa09619e5 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:12.064537 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7aa70f3f-e8ab-48ba-8ece-9b9aa09619e5 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:12.065180 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7aa70f3f-e8ab-48ba-8ece-9b9aa09619e5 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:12.443928 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-8d1bbed5-ca95-4dfb-8f7c-cfb3eec24b98 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:12.455274 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-8d1bbed5-ca95-4dfb-8f7c-cfb3eec24b98 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:12.466516 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-8d1bbed5-ca95-4dfb-8f7c-cfb3eec24b98 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:12.474006 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-8d1bbed5-ca95-4dfb-8f7c-cfb3eec24b98 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1725 microversion: 2.20 time: 0.465796 Aug 24 13:40:12.474453 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 87/173] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:12 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1725 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:12.484233 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-7aa70f3f-e8ab-48ba-8ece-9b9aa09619e5 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:12.495663 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-7aa70f3f-e8ab-48ba-8ece-9b9aa09619e5 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75" status: 200 len: 1503 microversion: 2.1 time: 0.468438 Aug 24 13:40:12.499480 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 87/174] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:12 2022] GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75 => generated 1503 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:40:12.501500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-95522274-67c3-490a-bb48-e71ca4687d21 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f4377f2-a0f1-4473-af0f-7b4b14e0661b"}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:40:12.508128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-95522274-67c3-490a-bb48-e71ca4687d21 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:12.527805 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-95522274-67c3-490a-bb48-e71ca4687d21 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:12.532649 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-95522274-67c3-490a-bb48-e71ca4687d21 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:12.533360 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-95522274-67c3-490a-bb48-e71ca4687d21 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:12.534101 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-95522274-67c3-490a-bb48-e71ca4687d21 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:12.534562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-95522274-67c3-490a-bb48-e71ca4687d21 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:12.534983 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-95522274-67c3-490a-bb48-e71ca4687d21 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:13.503046 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-8811e919-dd74-414e-b330-c87b92a2e836 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:13.504396 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-8811e919-dd74-414e-b330-c87b92a2e836 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:13.513598 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8811e919-dd74-414e-b330-c87b92a2e836 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:13.514773 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8811e919-dd74-414e-b330-c87b92a2e836 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:13.515674 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8811e919-dd74-414e-b330-c87b92a2e836 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:13.516658 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8811e919-dd74-414e-b330-c87b92a2e836 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:13.517475 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8811e919-dd74-414e-b330-c87b92a2e836 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:13.518275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8811e919-dd74-414e-b330-c87b92a2e836 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:13.672630 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-95522274-67c3-490a-bb48-e71ca4687d21 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "POST /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.184846 Aug 24 13:40:13.674869 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 88/175] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 13:40:12 2022] POST /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments => generated 194 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:40:13.689827 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-859b6f91-d0c1-42f5-80b7-4d7b84dd827f tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:13.691591 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-859b6f91-d0c1-42f5-80b7-4d7b84dd827f tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 7ae14fa1-f847-426c-82dd-2a6c76107b75] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:13.712679 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-859b6f91-d0c1-42f5-80b7-4d7b84dd827f tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:13.716666 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-859b6f91-d0c1-42f5-80b7-4d7b84dd827f tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:13.717540 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-859b6f91-d0c1-42f5-80b7-4d7b84dd827f tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:13.722599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-859b6f91-d0c1-42f5-80b7-4d7b84dd827f tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:13.723132 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-859b6f91-d0c1-42f5-80b7-4d7b84dd827f tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:13.725112 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-859b6f91-d0c1-42f5-80b7-4d7b84dd827f tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:13.861484 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-859b6f91-d0c1-42f5-80b7-4d7b84dd827f tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:13.873159 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-859b6f91-d0c1-42f5-80b7-4d7b84dd827f tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75" status: 200 len: 1298 microversion: 2.1 time: 0.196125 Aug 24 13:40:13.876589 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 89/176] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:13 2022] GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75 => generated 1298 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:13.883104 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-e31d0857-8962-4df6-b87d-276764333155 req-7a97a9e4-d4f3-40bb-8ea8-440d15ac8258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae14fa1-f847-426c-82dd-2a6c76107b75", "name": "network-vif-deleted", "tag": "50e41dde-e99c-4eee-8a5c-700ebbc96525"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:40:13.889833 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-8811e919-dd74-414e-b330-c87b92a2e836 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:13.898440 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-e31d0857-8962-4df6-b87d-276764333155 req-7a97a9e4-d4f3-40bb-8ea8-440d15ac8258 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:13.899147 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-e31d0857-8962-4df6-b87d-276764333155 req-7a97a9e4-d4f3-40bb-8ea8-440d15ac8258 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:13.899950 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-e31d0857-8962-4df6-b87d-276764333155 req-7a97a9e4-d4f3-40bb-8ea8-440d15ac8258 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:13.916812 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-8811e919-dd74-414e-b330-c87b92a2e836 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:13.918873 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-8811e919-dd74-414e-b330-c87b92a2e836 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:13.925103 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-8811e919-dd74-414e-b330-c87b92a2e836 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1725 microversion: 2.20 time: 0.425256 Aug 24 13:40:13.926412 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 88/177] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:13 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1725 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:40:13.927170 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-e31d0857-8962-4df6-b87d-276764333155 req-7a97a9e4-d4f3-40bb-8ea8-440d15ac8258 service nova] Creating event network-vif-deleted:50e41dde-e99c-4eee-8a5c-700ebbc96525 for instance 7ae14fa1-f847-426c-82dd-2a6c76107b75 on hv-cinder-77957 Aug 24 13:40:13.932734 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-e31d0857-8962-4df6-b87d-276764333155 req-7a97a9e4-d4f3-40bb-8ea8-440d15ac8258 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054698 Aug 24 13:40:13.934451 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 90/178] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:40:14.501215 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-efec54e7-353a-4f2c-9055-b1ee19ebcd53 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1794629100", "imageRef": "c520113c-3dae-4490-98bb-19fe3a46b66d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:40:14.571362 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.network.neutron [None req-efec54e7-353a-4f2c-9055-b1ee19ebcd53 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] validate_networks() for [('1fcb22e0-a643-462e-8b2f-3661641fd3fe', None, None, None, None, None)] {{(pid=133014) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:40:14.899486 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-79c3ff53-8a0c-4317-b8e5-7e131257a9fb tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:14.900822 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-79c3ff53-8a0c-4317-b8e5-7e131257a9fb tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 7ae14fa1-f847-426c-82dd-2a6c76107b75] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:14.917843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-79c3ff53-8a0c-4317-b8e5-7e131257a9fb tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:14.918686 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-79c3ff53-8a0c-4317-b8e5-7e131257a9fb tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:14.919298 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-79c3ff53-8a0c-4317-b8e5-7e131257a9fb tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:14.920475 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-79c3ff53-8a0c-4317-b8e5-7e131257a9fb tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:14.921051 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-79c3ff53-8a0c-4317-b8e5-7e131257a9fb tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:14.921728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-79c3ff53-8a0c-4317-b8e5-7e131257a9fb tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:14.961591 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-79c3ff53-8a0c-4317-b8e5-7e131257a9fb tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:14.962079 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-79c3ff53-8a0c-4317-b8e5-7e131257a9fb tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:14.962506 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-79c3ff53-8a0c-4317-b8e5-7e131257a9fb tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:14.962955 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.objects.instance [None req-79c3ff53-8a0c-4317-b8e5-7e131257a9fb tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lazy-loading 'fault' on Instance uuid 7ae14fa1-f847-426c-82dd-2a6c76107b75 {{(pid=133015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:40:15.060483 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-79c3ff53-8a0c-4317-b8e5-7e131257a9fb tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:15.071950 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-79c3ff53-8a0c-4317-b8e5-7e131257a9fb tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75" status: 200 len: 1303 microversion: 2.1 time: 0.175086 Aug 24 13:40:15.087778 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 91/179] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:14 2022] GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75 => generated 1303 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:40:15.087778 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-3c0c67c7-2f5a-4df1-90f4-8f2b73e77893 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:15.087778 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-3c0c67c7-2f5a-4df1-90f4-8f2b73e77893 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:15.087778 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3c0c67c7-2f5a-4df1-90f4-8f2b73e77893 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:15.088425 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3c0c67c7-2f5a-4df1-90f4-8f2b73e77893 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:15.088769 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3c0c67c7-2f5a-4df1-90f4-8f2b73e77893 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:15.089426 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3c0c67c7-2f5a-4df1-90f4-8f2b73e77893 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:15.090180 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3c0c67c7-2f5a-4df1-90f4-8f2b73e77893 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:15.090764 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3c0c67c7-2f5a-4df1-90f4-8f2b73e77893 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:15.252326 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-efec54e7-353a-4f2c-9055-b1ee19ebcd53 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Flavor limits 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:40:15.252755 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-efec54e7-353a-4f2c-9055-b1ee19ebcd53 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Image limits 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:40:15.259381 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-efec54e7-353a-4f2c-9055-b1ee19ebcd53 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Flavor pref 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:40:15.259902 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-efec54e7-353a-4f2c-9055-b1ee19ebcd53 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Image pref 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:40:15.264564 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-efec54e7-353a-4f2c-9055-b1ee19ebcd53 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:40:15.277925 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-efec54e7-353a-4f2c-9055-b1ee19ebcd53 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:15.284793 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-efec54e7-353a-4f2c-9055-b1ee19ebcd53 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:15.286030 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-efec54e7-353a-4f2c-9055-b1ee19ebcd53 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:15.293023 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-efec54e7-353a-4f2c-9055-b1ee19ebcd53 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:15.293638 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-efec54e7-353a-4f2c-9055-b1ee19ebcd53 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:15.300844 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-efec54e7-353a-4f2c-9055-b1ee19ebcd53 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:15.332398 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-3c0c67c7-2f5a-4df1-90f4-8f2b73e77893 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:15.343256 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-3c0c67c7-2f5a-4df1-90f4-8f2b73e77893 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:15.343498 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-efec54e7-353a-4f2c-9055-b1ee19ebcd53 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Getting quotas for project 127e5da55b164ce68568c153fee58baf. Resources: {'instances', 'cores', 'ram'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:40:15.345844 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-3c0c67c7-2f5a-4df1-90f4-8f2b73e77893 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:15.347552 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-3c0c67c7-2f5a-4df1-90f4-8f2b73e77893 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1725 microversion: 2.20 time: 0.273667 Aug 24 13:40:15.356308 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-efec54e7-353a-4f2c-9055-b1ee19ebcd53 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Getting quotas for user adb792e7246d42dface4aa52899a0ffc and project 127e5da55b164ce68568c153fee58baf. Resources: {'instances', 'cores', 'ram'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:40:15.360859 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 92/180] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:15 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1725 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:15.370042 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-efec54e7-353a-4f2c-9055-b1ee19ebcd53 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Going to run 1 instances... {{(pid=133014) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 13:40:15.372765 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-efec54e7-353a-4f2c-9055-b1ee19ebcd53 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c520113c-3dae-4490-98bb-19fe3a46b66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133014) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 13:40:15.585486 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-efec54e7-353a-4f2c-9055-b1ee19ebcd53 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.292250 Aug 24 13:40:15.586145 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 89/181] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 13:40:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 13:40:15.597831 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-1364b50a-5d9f-4586-b2eb-5028a5883be6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:15.598735 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-1364b50a-5d9f-4586-b2eb-5028a5883be6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:15.662998 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-1364b50a-5d9f-4586-b2eb-5028a5883be6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:15.680028 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-1364b50a-5d9f-4586-b2eb-5028a5883be6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1222 microversion: 2.1 time: 0.086512 Aug 24 13:40:15.682334 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 93/182] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:15 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:16.065675 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-fb4c8aaa-e83e-4f9b-95bb-6889432dc9e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1338225392", "imageRef": "c520113c-3dae-4490-98bb-19fe3a46b66d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:40:16.110867 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a7a2c7ff-4a79-40e1-b518-321675b51b53 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:16.111965 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-a7a2c7ff-4a79-40e1-b518-321675b51b53 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 7ae14fa1-f847-426c-82dd-2a6c76107b75] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:16.139495 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a7a2c7ff-4a79-40e1-b518-321675b51b53 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:16.140591 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a7a2c7ff-4a79-40e1-b518-321675b51b53 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:16.142609 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a7a2c7ff-4a79-40e1-b518-321675b51b53 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:16.143541 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a7a2c7ff-4a79-40e1-b518-321675b51b53 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:16.144020 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a7a2c7ff-4a79-40e1-b518-321675b51b53 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:16.146046 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.network.neutron [None req-fb4c8aaa-e83e-4f9b-95bb-6889432dc9e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] validate_networks() for [('1fcb22e0-a643-462e-8b2f-3661641fd3fe', None, None, None, None, None)] {{(pid=133014) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:40:16.152630 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a7a2c7ff-4a79-40e1-b518-321675b51b53 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:16.218588 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.wsgi [None req-a7a2c7ff-4a79-40e1-b518-321675b51b53 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] HTTP exception thrown: Instance 7ae14fa1-f847-426c-82dd-2a6c76107b75 could not be found. Aug 24 13:40:16.220389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a7a2c7ff-4a79-40e1-b518-321675b51b53 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Request method failure captured: Aug 24 13:40:16.220389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75 HTTP/1.1 Aug 24 13:40:16.220389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:40:16.220389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:40:16.220389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:40:16.220389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 0 Aug 24 13:40:16.220389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:40:16.220389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:40:16.220389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:40:16.220389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:40:16.220389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBioiKeiczLI1cNZ2ea05cDeEtiFB7Q3jSOww1U99sv3nJN_aycwbturPOamMj48VZS5feqdG10INvjIBwQbGHwSRaJnnEA7me2Qigcz7VhNO5gsxBO_-0ru0cTCVUqun1RaQjSdsWTy5YEBya7TEMaLZt4Iz6RAFY6KPAugOAUwo7qA Aug 24 13:40:16.220389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:40:16.220389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:40:16.220389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:40:16.220389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:40:16.220389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:40:16.220389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:40:16.220389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: c22fb394e99345d88b2e082b22902af3 Aug 24 13:40:16.220389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-VolumesActionsTest-1917751200 Aug 24 13:40:16.220389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:40:16.220389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:40:16.221796 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c22fb394e99345d88b2e082b22902af3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c22fb394e99345d88b2e082b22902af3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c22fb394e99345d88b2e082b22902af3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c22fb394e99345d88b2e082b22902af3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:40:16.221796 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-VolumesActionsTest-1917751200 Aug 24 13:40:16.221796 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: c22fb394e99345d88b2e082b22902af3 Aug 24 13:40:16.221796 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-VolumesActionsTest-1917751200 Aug 24 13:40:16.221796 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-VolumesActionsTest-1917751200-project Aug 24 13:40:16.221796 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:40:16.221796 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:40:16.221796 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: e9c7ecfdb9904095b122bb8fd82121fe Aug 24 13:40:16.221796 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-VolumesActionsTest-1917751200-project Aug 24 13:40:16.221796 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: > Aug 24 13:40:16.221796 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Instance 7ae14fa1-f847-426c-82dd-2a6c76107b75 could not be found. Aug 24 13:40:16.221796 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'id': '7ae14fa1-f847-426c-82dd-2a6c76107b75'} Aug 24 13:40:16.222562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:40:16.222562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:40:16.222562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:40:16.222562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:40:16.222562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:40:16.222562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:40:16.222562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:40:16.222562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:40:16.222562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:40:16.222562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:40:16.222562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ae14fa1-f847-426c-82dd-2a6c76107b75 could not be found. Aug 24 13:40:16.222562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:40:16.222562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:40:16.222562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:40:16.222562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:40:16.222562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:40:16.222562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:40:16.222562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:40:16.222562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:40:16.222562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:40:16.223996 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:40:16.223996 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:40:16.223996 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:40:16.223996 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:40:16.223996 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:40:16.223996 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:40:16.223996 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:40:16.223996 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ae14fa1-f847-426c-82dd-2a6c76107b75 could not be found. Aug 24 13:40:16.223996 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:40:16.223996 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:40:16.223996 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:40:16.223996 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:40:16.223996 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:40:16.223996 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:40:16.223996 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:40:16.223996 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:40:16.223996 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ae14fa1-f847-426c-82dd-2a6c76107b75 could not be found. Aug 24 13:40:16.223996 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:40:16.225016 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a7a2c7ff-4a79-40e1-b518-321675b51b53 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Returning 404 to user: Instance 7ae14fa1-f847-426c-82dd-2a6c76107b75 could not be found. {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:40:16.225016 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a7a2c7ff-4a79-40e1-b518-321675b51b53 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75" status: 404 len: 111 microversion: 2.1 time: 0.124598 Aug 24 13:40:16.228342 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 94/183] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:16 2022] GET /compute/v2.1/servers/7ae14fa1-f847-426c-82dd-2a6c76107b75 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:40:16.372986 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-4164bae2-5897-48b4-a47f-78a177274ddf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:16.374217 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-4164bae2-5897-48b4-a47f-78a177274ddf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:16.391815 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4164bae2-5897-48b4-a47f-78a177274ddf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:16.392341 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4164bae2-5897-48b4-a47f-78a177274ddf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:16.392781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4164bae2-5897-48b4-a47f-78a177274ddf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:16.393487 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4164bae2-5897-48b4-a47f-78a177274ddf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:16.393941 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4164bae2-5897-48b4-a47f-78a177274ddf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:16.394370 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4164bae2-5897-48b4-a47f-78a177274ddf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:17.127436 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4164bae2-5897-48b4-a47f-78a177274ddf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:17.143504 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4164bae2-5897-48b4-a47f-78a177274ddf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:17.145505 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4164bae2-5897-48b4-a47f-78a177274ddf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:17.146735 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-4164bae2-5897-48b4-a47f-78a177274ddf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1725 microversion: 2.20 time: 0.779071 Aug 24 13:40:17.160325 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 95/184] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:16 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1725 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:17.160325 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b1be1946-96b5-48ae-a545-371ab5017094 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-683763270", "imageRef": "c520113c-3dae-4490-98bb-19fe3a46b66d", "flavorRef": "452", "networks": [{"uuid": "c0c5540c-3e08-475c-a808-3a64025a5c41"}]}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:40:17.174917 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:40:17.272401 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.network.neutron [None req-b1be1946-96b5-48ae-a545-371ab5017094 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] validate_networks() for [('c0c5540c-3e08-475c-a808-3a64025a5c41', None, None, None, None, None)] {{(pid=133015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:40:17.471442 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-fb4c8aaa-e83e-4f9b-95bb-6889432dc9e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Flavor limits 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:40:17.472095 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-fb4c8aaa-e83e-4f9b-95bb-6889432dc9e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Image limits 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:40:17.472460 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-fb4c8aaa-e83e-4f9b-95bb-6889432dc9e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Flavor pref 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:40:17.472877 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-fb4c8aaa-e83e-4f9b-95bb-6889432dc9e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Image pref 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:40:17.473380 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-fb4c8aaa-e83e-4f9b-95bb-6889432dc9e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:40:17.486975 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fb4c8aaa-e83e-4f9b-95bb-6889432dc9e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:17.487778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fb4c8aaa-e83e-4f9b-95bb-6889432dc9e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:17.488451 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fb4c8aaa-e83e-4f9b-95bb-6889432dc9e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:17.489376 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fb4c8aaa-e83e-4f9b-95bb-6889432dc9e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:17.489997 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fb4c8aaa-e83e-4f9b-95bb-6889432dc9e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:17.490628 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fb4c8aaa-e83e-4f9b-95bb-6889432dc9e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:17.516550 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-fb4c8aaa-e83e-4f9b-95bb-6889432dc9e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Getting quotas for project 127e5da55b164ce68568c153fee58baf. Resources: {'instances', 'cores', 'ram'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:40:17.521323 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-fb4c8aaa-e83e-4f9b-95bb-6889432dc9e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Getting quotas for user adb792e7246d42dface4aa52899a0ffc and project 127e5da55b164ce68568c153fee58baf. Resources: {'instances', 'cores', 'ram'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:40:17.547482 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-fb4c8aaa-e83e-4f9b-95bb-6889432dc9e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Going to run 1 instances... {{(pid=133014) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 13:40:17.562196 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-fb4c8aaa-e83e-4f9b-95bb-6889432dc9e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c520113c-3dae-4490-98bb-19fe3a46b66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133014) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 13:40:17.772790 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-fb4c8aaa-e83e-4f9b-95bb-6889432dc9e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.720009 Aug 24 13:40:17.776378 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 90/185] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 13:40:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 1727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 13:40:17.796427 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-28b92861-699b-4789-a9c6-86a74f6183cf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:17.822434 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-28b92861-699b-4789-a9c6-86a74f6183cf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:17.928828 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-28b92861-699b-4789-a9c6-86a74f6183cf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:17.944141 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-28b92861-699b-4789-a9c6-86a74f6183cf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1222 microversion: 2.1 time: 0.153138 Aug 24 13:40:17.947549 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 91/186] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:17 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1222 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:18.175174 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-b1be1946-96b5-48ae-a545-371ab5017094 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Flavor limits 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:40:18.175920 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-b1be1946-96b5-48ae-a545-371ab5017094 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Image limits 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:40:18.176154 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-71d514d2-eac6-4378-8730-49642bf75911 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:18.176969 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-71d514d2-eac6-4378-8730-49642bf75911 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:18.179065 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-b1be1946-96b5-48ae-a545-371ab5017094 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Flavor pref 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:40:18.179691 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-b1be1946-96b5-48ae-a545-371ab5017094 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Image pref 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:40:18.181613 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-b1be1946-96b5-48ae-a545-371ab5017094 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:40:18.198820 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b1be1946-96b5-48ae-a545-371ab5017094 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:18.205337 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b1be1946-96b5-48ae-a545-371ab5017094 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:18.205560 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-71d514d2-eac6-4378-8730-49642bf75911 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:18.206005 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-71d514d2-eac6-4378-8730-49642bf75911 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:18.206442 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-71d514d2-eac6-4378-8730-49642bf75911 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:18.206935 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b1be1946-96b5-48ae-a545-371ab5017094 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:18.209839 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-71d514d2-eac6-4378-8730-49642bf75911 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:18.209963 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b1be1946-96b5-48ae-a545-371ab5017094 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:18.210323 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-71d514d2-eac6-4378-8730-49642bf75911 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:18.210754 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-71d514d2-eac6-4378-8730-49642bf75911 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:18.211788 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b1be1946-96b5-48ae-a545-371ab5017094 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:18.213046 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b1be1946-96b5-48ae-a545-371ab5017094 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:18.266382 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-b1be1946-96b5-48ae-a545-371ab5017094 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Getting quotas for project c22fb394e99345d88b2e082b22902af3. Resources: {'instances', 'cores', 'ram'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:40:18.272047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-b1be1946-96b5-48ae-a545-371ab5017094 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Getting quotas for user e9c7ecfdb9904095b122bb8fd82121fe and project c22fb394e99345d88b2e082b22902af3. Resources: {'instances', 'cores', 'ram'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:40:18.296874 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b1be1946-96b5-48ae-a545-371ab5017094 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Going to run 1 instances... {{(pid=133015) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 13:40:18.310700 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b1be1946-96b5-48ae-a545-371ab5017094 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c520113c-3dae-4490-98bb-19fe3a46b66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 13:40:18.470489 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-71d514d2-eac6-4378-8730-49642bf75911 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:18.489201 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-71d514d2-eac6-4378-8730-49642bf75911 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:18.491937 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-71d514d2-eac6-4378-8730-49642bf75911 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:18.493504 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-71d514d2-eac6-4378-8730-49642bf75911 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1725 microversion: 2.20 time: 0.323866 Aug 24 13:40:18.494392 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 92/187] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:18 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1725 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:18.583251 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b1be1946-96b5-48ae-a545-371ab5017094 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.432443 Aug 24 13:40:18.593449 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 96/188] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 13:40:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 13:40:18.609339 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-c0ad0fec-08bb-4608-973b-9eb4f4bc8172 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:18.614460 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-c0ad0fec-08bb-4608-973b-9eb4f4bc8172 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:18.749832 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-c0ad0fec-08bb-4608-973b-9eb4f4bc8172 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:18.758686 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-c0ad0fec-08bb-4608-973b-9eb4f4bc8172 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 200 len: 1213 microversion: 2.1 time: 0.152633 Aug 24 13:40:18.758686 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 93/189] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:18 2022] GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 1213 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:18.971617 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-6260de24-79b3-43b6-b7b0-69e9354c147b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:18.972486 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-6260de24-79b3-43b6-b7b0-69e9354c147b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:19.077306 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-6260de24-79b3-43b6-b7b0-69e9354c147b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:19.088962 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-6260de24-79b3-43b6-b7b0-69e9354c147b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1222 microversion: 2.1 time: 0.123179 Aug 24 13:40:19.091099 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 97/190] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:18 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1222 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:19.523138 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-06fc93d9-70c7-456d-beae-84818046c9c3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:19.523752 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-06fc93d9-70c7-456d-beae-84818046c9c3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:19.525881 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:40:19.531049 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-06fc93d9-70c7-456d-beae-84818046c9c3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:19.531795 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-06fc93d9-70c7-456d-beae-84818046c9c3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:19.532334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-06fc93d9-70c7-456d-beae-84818046c9c3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:19.533035 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-06fc93d9-70c7-456d-beae-84818046c9c3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:19.533482 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-06fc93d9-70c7-456d-beae-84818046c9c3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:19.533925 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-06fc93d9-70c7-456d-beae-84818046c9c3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:19.693593 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-06fc93d9-70c7-456d-beae-84818046c9c3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:19.703741 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-06fc93d9-70c7-456d-beae-84818046c9c3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:19.722147 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-06fc93d9-70c7-456d-beae-84818046c9c3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:19.722147 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-06fc93d9-70c7-456d-beae-84818046c9c3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1725 microversion: 2.20 time: 0.187598 Aug 24 13:40:19.722147 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 94/191] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:19 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:19.779633 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-7afba093-0f85-436c-9f62-4127c3b7a8cc tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:19.780347 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-7afba093-0f85-436c-9f62-4127c3b7a8cc tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:19.843935 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-7afba093-0f85-436c-9f62-4127c3b7a8cc tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:19.851184 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-7afba093-0f85-436c-9f62-4127c3b7a8cc tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 200 len: 1213 microversion: 2.1 time: 0.077116 Aug 24 13:40:19.865610 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 98/192] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:19 2022] GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:20.115797 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-2d14ecbd-6a9d-46b6-9020-93f8a16396e1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:20.117396 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-2d14ecbd-6a9d-46b6-9020-93f8a16396e1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:20.125070 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2d14ecbd-6a9d-46b6-9020-93f8a16396e1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:20.125822 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2d14ecbd-6a9d-46b6-9020-93f8a16396e1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:20.126498 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2d14ecbd-6a9d-46b6-9020-93f8a16396e1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:20.127232 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2d14ecbd-6a9d-46b6-9020-93f8a16396e1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:20.127702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2d14ecbd-6a9d-46b6-9020-93f8a16396e1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:20.128125 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2d14ecbd-6a9d-46b6-9020-93f8a16396e1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:20.242329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-2d14ecbd-6a9d-46b6-9020-93f8a16396e1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:20.256886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-2d14ecbd-6a9d-46b6-9020-93f8a16396e1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1226 microversion: 2.1 time: 0.149387 Aug 24 13:40:20.259268 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 95/193] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:20 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1226 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:20.731773 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-06fc6ef9-dd40-4072-b4d8-6692399f58e3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:20.732423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-06fc6ef9-dd40-4072-b4d8-6692399f58e3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:20.739147 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-06fc6ef9-dd40-4072-b4d8-6692399f58e3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:20.739631 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-06fc6ef9-dd40-4072-b4d8-6692399f58e3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:20.740316 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-06fc6ef9-dd40-4072-b4d8-6692399f58e3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:20.741283 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-06fc6ef9-dd40-4072-b4d8-6692399f58e3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:20.741777 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-06fc6ef9-dd40-4072-b4d8-6692399f58e3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:20.742195 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-06fc6ef9-dd40-4072-b4d8-6692399f58e3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:20.872889 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-431f5c70-313b-4d95-9b48-d45729a7d3a6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:20.876410 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-431f5c70-313b-4d95-9b48-d45729a7d3a6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:20.883917 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-431f5c70-313b-4d95-9b48-d45729a7d3a6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:20.884659 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-431f5c70-313b-4d95-9b48-d45729a7d3a6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:20.885104 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-431f5c70-313b-4d95-9b48-d45729a7d3a6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:20.885803 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-431f5c70-313b-4d95-9b48-d45729a7d3a6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:20.886267 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-431f5c70-313b-4d95-9b48-d45729a7d3a6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:20.886851 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-431f5c70-313b-4d95-9b48-d45729a7d3a6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:20.981364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-431f5c70-313b-4d95-9b48-d45729a7d3a6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:20.990283 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-431f5c70-313b-4d95-9b48-d45729a7d3a6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 200 len: 1217 microversion: 2.1 time: 0.121073 Aug 24 13:40:21.004239 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 96/194] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:20 2022] GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 1217 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:40:21.042368 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-06fc6ef9-dd40-4072-b4d8-6692399f58e3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:21.048086 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-06fc6ef9-dd40-4072-b4d8-6692399f58e3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:21.049848 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-06fc6ef9-dd40-4072-b4d8-6692399f58e3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:21.051277 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-06fc6ef9-dd40-4072-b4d8-6692399f58e3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1725 microversion: 2.20 time: 0.323629 Aug 24 13:40:21.051945 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 99/195] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:20 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1725 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:21.286684 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-b07866b6-510c-43e5-9a44-533f0334f40e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:21.287534 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-b07866b6-510c-43e5-9a44-533f0334f40e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:21.295678 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b07866b6-510c-43e5-9a44-533f0334f40e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:21.296601 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b07866b6-510c-43e5-9a44-533f0334f40e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:21.297208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b07866b6-510c-43e5-9a44-533f0334f40e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:21.298098 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b07866b6-510c-43e5-9a44-533f0334f40e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:21.298743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b07866b6-510c-43e5-9a44-533f0334f40e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:21.299333 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b07866b6-510c-43e5-9a44-533f0334f40e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:21.385526 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-b07866b6-510c-43e5-9a44-533f0334f40e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:21.394567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-b07866b6-510c-43e5-9a44-533f0334f40e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1274 microversion: 2.1 time: 0.111790 Aug 24 13:40:21.395339 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 97/196] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:21 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1274 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:40:21.726698 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-d95bca77-1fe3-4e54-ba36-f77711083417 req-879c3a20-78ae-4fec-8215-20daeba9a37b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08ba9691-685f-444a-9c86-9ac1562acbf0", "tag": "88ef4e43-75b6-482c-8852-e8293b84a9ab"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:40:21.748582 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-d95bca77-1fe3-4e54-ba36-f77711083417 req-879c3a20-78ae-4fec-8215-20daeba9a37b service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:21.748582 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-d95bca77-1fe3-4e54-ba36-f77711083417 req-879c3a20-78ae-4fec-8215-20daeba9a37b service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:21.749489 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-d95bca77-1fe3-4e54-ba36-f77711083417 req-879c3a20-78ae-4fec-8215-20daeba9a37b service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:21.764615 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-d95bca77-1fe3-4e54-ba36-f77711083417 req-879c3a20-78ae-4fec-8215-20daeba9a37b service nova] Creating event network-changed:88ef4e43-75b6-482c-8852-e8293b84a9ab for instance 08ba9691-685f-444a-9c86-9ac1562acbf0 on hv-cinder-77957 Aug 24 13:40:21.769651 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-d95bca77-1fe3-4e54-ba36-f77711083417 req-879c3a20-78ae-4fec-8215-20daeba9a37b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053862 Aug 24 13:40:21.770504 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 100/197] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:40:22.011186 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e7249edc-add3-4bc9-a766-499fda1eb514 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:22.011695 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-e7249edc-add3-4bc9-a766-499fda1eb514 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:22.018076 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e7249edc-add3-4bc9-a766-499fda1eb514 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:22.018559 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e7249edc-add3-4bc9-a766-499fda1eb514 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:22.018989 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e7249edc-add3-4bc9-a766-499fda1eb514 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:22.019682 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e7249edc-add3-4bc9-a766-499fda1eb514 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:22.020132 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e7249edc-add3-4bc9-a766-499fda1eb514 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:22.020583 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e7249edc-add3-4bc9-a766-499fda1eb514 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:22.092886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e7249edc-add3-4bc9-a766-499fda1eb514 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:22.093982 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-ef76f5fc-4c55-4313-8e3e-6c015d66b7da tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:22.094683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-ef76f5fc-4c55-4313-8e3e-6c015d66b7da tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:22.100956 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-e7249edc-add3-4bc9-a766-499fda1eb514 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 200 len: 1217 microversion: 2.1 time: 0.093722 Aug 24 13:40:22.101136 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ef76f5fc-4c55-4313-8e3e-6c015d66b7da tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:22.101482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ef76f5fc-4c55-4313-8e3e-6c015d66b7da tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:22.101622 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 98/198] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:22 2022] GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:22.101916 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ef76f5fc-4c55-4313-8e3e-6c015d66b7da tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:22.102632 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ef76f5fc-4c55-4313-8e3e-6c015d66b7da tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:22.103078 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ef76f5fc-4c55-4313-8e3e-6c015d66b7da tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:22.103500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ef76f5fc-4c55-4313-8e3e-6c015d66b7da tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:22.252101 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-ef76f5fc-4c55-4313-8e3e-6c015d66b7da tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:22.261474 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-ef76f5fc-4c55-4313-8e3e-6c015d66b7da tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:22.262888 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-ef76f5fc-4c55-4313-8e3e-6c015d66b7da tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:22.265090 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-ef76f5fc-4c55-4313-8e3e-6c015d66b7da tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1725 microversion: 2.20 time: 0.176443 Aug 24 13:40:22.265796 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 101/199] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:22 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:40:22.415858 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-c360ce15-a5c4-4b82-ad51-40209764f25f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:22.416681 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-c360ce15-a5c4-4b82-ad51-40209764f25f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:22.422941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c360ce15-a5c4-4b82-ad51-40209764f25f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:22.423417 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c360ce15-a5c4-4b82-ad51-40209764f25f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:22.423846 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c360ce15-a5c4-4b82-ad51-40209764f25f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:22.424571 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c360ce15-a5c4-4b82-ad51-40209764f25f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:22.425021 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c360ce15-a5c4-4b82-ad51-40209764f25f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:22.425437 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c360ce15-a5c4-4b82-ad51-40209764f25f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:22.493456 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-c360ce15-a5c4-4b82-ad51-40209764f25f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:22.502786 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-c360ce15-a5c4-4b82-ad51-40209764f25f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1274 microversion: 2.1 time: 0.090769 Aug 24 13:40:22.503371 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 99/200] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:22 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:23.122563 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-281725a1-7576-4ee2-a722-80ab4c60a67c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:23.123495 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-281725a1-7576-4ee2-a722-80ab4c60a67c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:23.130108 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-281725a1-7576-4ee2-a722-80ab4c60a67c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:23.130579 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-281725a1-7576-4ee2-a722-80ab4c60a67c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:23.131010 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-281725a1-7576-4ee2-a722-80ab4c60a67c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:23.131767 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-281725a1-7576-4ee2-a722-80ab4c60a67c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:23.132229 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-281725a1-7576-4ee2-a722-80ab4c60a67c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:23.132644 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-281725a1-7576-4ee2-a722-80ab4c60a67c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:23.197784 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-281725a1-7576-4ee2-a722-80ab4c60a67c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:23.206920 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-281725a1-7576-4ee2-a722-80ab4c60a67c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 200 len: 1217 microversion: 2.1 time: 0.088172 Aug 24 13:40:23.207512 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 102/201] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:23 2022] GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:23.288633 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a3ccd9c5-f12c-4244-bd3b-236166ca2544 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:23.289385 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a3ccd9c5-f12c-4244-bd3b-236166ca2544 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:23.297297 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a3ccd9c5-f12c-4244-bd3b-236166ca2544 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:23.297786 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a3ccd9c5-f12c-4244-bd3b-236166ca2544 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:23.298229 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a3ccd9c5-f12c-4244-bd3b-236166ca2544 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:23.298954 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a3ccd9c5-f12c-4244-bd3b-236166ca2544 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:23.299417 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a3ccd9c5-f12c-4244-bd3b-236166ca2544 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:23.299841 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a3ccd9c5-f12c-4244-bd3b-236166ca2544 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:23.454636 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a3ccd9c5-f12c-4244-bd3b-236166ca2544 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:23.465182 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a3ccd9c5-f12c-4244-bd3b-236166ca2544 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:23.467406 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a3ccd9c5-f12c-4244-bd3b-236166ca2544 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:23.468881 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a3ccd9c5-f12c-4244-bd3b-236166ca2544 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1725 microversion: 2.20 time: 0.184350 Aug 24 13:40:23.469524 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 100/202] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:23 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:23.525456 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-4d5e6447-2406-4355-891a-cda80f4e2b75 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:23.526461 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-4d5e6447-2406-4355-891a-cda80f4e2b75 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:23.535420 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4d5e6447-2406-4355-891a-cda80f4e2b75 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:23.536586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4d5e6447-2406-4355-891a-cda80f4e2b75 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:23.537526 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4d5e6447-2406-4355-891a-cda80f4e2b75 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:23.538469 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4d5e6447-2406-4355-891a-cda80f4e2b75 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:23.539347 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4d5e6447-2406-4355-891a-cda80f4e2b75 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:23.539836 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4d5e6447-2406-4355-891a-cda80f4e2b75 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:23.616686 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4d5e6447-2406-4355-891a-cda80f4e2b75 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:23.622059 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-4d5e6447-2406-4355-891a-cda80f4e2b75 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1274 microversion: 2.1 time: 0.100624 Aug 24 13:40:23.622547 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 103/203] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:23 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1274 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:24.229436 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-785796f0-ac5d-49cd-b745-e36e4ffe2e0c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:24.230061 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-785796f0-ac5d-49cd-b745-e36e4ffe2e0c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:24.237208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-785796f0-ac5d-49cd-b745-e36e4ffe2e0c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:24.237718 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-785796f0-ac5d-49cd-b745-e36e4ffe2e0c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:24.238160 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-785796f0-ac5d-49cd-b745-e36e4ffe2e0c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:24.239457 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-785796f0-ac5d-49cd-b745-e36e4ffe2e0c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:24.239933 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-785796f0-ac5d-49cd-b745-e36e4ffe2e0c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:24.240398 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-785796f0-ac5d-49cd-b745-e36e4ffe2e0c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:24.318939 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-785796f0-ac5d-49cd-b745-e36e4ffe2e0c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:24.333403 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-785796f0-ac5d-49cd-b745-e36e4ffe2e0c tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 200 len: 1209 microversion: 2.1 time: 0.107654 Aug 24 13:40:24.334879 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 101/204] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:24 2022] GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 1209 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:24.492654 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-1bad72b4-1a1b-4bcb-8320-68f36476ce33 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:24.494066 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-1bad72b4-1a1b-4bcb-8320-68f36476ce33 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:24.503694 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1bad72b4-1a1b-4bcb-8320-68f36476ce33 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:24.504875 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1bad72b4-1a1b-4bcb-8320-68f36476ce33 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:24.505534 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1bad72b4-1a1b-4bcb-8320-68f36476ce33 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:24.506655 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1bad72b4-1a1b-4bcb-8320-68f36476ce33 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:24.508978 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1bad72b4-1a1b-4bcb-8320-68f36476ce33 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:24.508978 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1bad72b4-1a1b-4bcb-8320-68f36476ce33 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:24.605981 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-aa039d32-a46f-4a99-9284-426e87b92015 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Action: 'create', calling method: .version_select at 0x7f96c2b81790>, body: {"keypair": {"name": "tempest-keypair-1348800994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1uPDAhCB92cbzT1soxhUBd9kKgpG3M+q+EAhnfg4Oee5QdP3OfTf0WqgDAKuKR4dhXaFkdZIo0/ILBMrh/9RPB7CcSBPltOyVMvWicNslDBIWjsr89001Bd+hi41RM0A=="}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:40:24.628348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-aa039d32-a46f-4a99-9284-426e87b92015 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Getting quotas for project 019b2e8bdb934d94a25fe4b355e73c68. Resources: {'key_pairs'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:40:24.632725 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-aa039d32-a46f-4a99-9284-426e87b92015 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Getting quotas for user ea9d4eafe59c4c8180eece8ec9283e40 and project 019b2e8bdb934d94a25fe4b355e73c68. Resources: {'key_pairs'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:40:24.669536 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-1bad72b4-1a1b-4bcb-8320-68f36476ce33 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:24.678538 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-1bad72b4-1a1b-4bcb-8320-68f36476ce33 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:24.680035 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-1bad72b4-1a1b-4bcb-8320-68f36476ce33 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:24.681319 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-1bad72b4-1a1b-4bcb-8320-68f36476ce33 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1725 microversion: 2.20 time: 0.193880 Aug 24 13:40:24.682279 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 104/205] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:24 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:24.688477 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-09697b65-0166-4e7c-b621-41b799520e2f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:24.689104 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-09697b65-0166-4e7c-b621-41b799520e2f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:24.696586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-09697b65-0166-4e7c-b621-41b799520e2f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:24.697632 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-09697b65-0166-4e7c-b621-41b799520e2f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:24.698557 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-09697b65-0166-4e7c-b621-41b799520e2f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:24.699534 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-09697b65-0166-4e7c-b621-41b799520e2f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:24.700220 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-09697b65-0166-4e7c-b621-41b799520e2f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:24.700858 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-09697b65-0166-4e7c-b621-41b799520e2f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:24.753799 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-aa039d32-a46f-4a99-9284-426e87b92015 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.151624 Aug 24 13:40:24.761171 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 102/206] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 13:40:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:40:24.819518 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-09697b65-0166-4e7c-b621-41b799520e2f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:24.829845 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-09697b65-0166-4e7c-b621-41b799520e2f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1292 microversion: 2.1 time: 0.146537 Aug 24 13:40:24.830948 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 105/207] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:24 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1292 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:25.433362 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-d41b51df-483b-4600-b5a4-bd2c2b861f13 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:25.433362 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-d41b51df-483b-4600-b5a4-bd2c2b861f13 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:25.433362 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d41b51df-483b-4600-b5a4-bd2c2b861f13 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:25.433362 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d41b51df-483b-4600-b5a4-bd2c2b861f13 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:25.434959 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d41b51df-483b-4600-b5a4-bd2c2b861f13 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:25.434959 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d41b51df-483b-4600-b5a4-bd2c2b861f13 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:25.434959 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d41b51df-483b-4600-b5a4-bd2c2b861f13 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:25.434959 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d41b51df-483b-4600-b5a4-bd2c2b861f13 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:25.437765 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-d41b51df-483b-4600-b5a4-bd2c2b861f13 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:25.445932 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-d41b51df-483b-4600-b5a4-bd2c2b861f13 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 200 len: 1265 microversion: 2.1 time: 0.092540 Aug 24 13:40:25.446515 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 103/208] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:25 2022] GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:40:25.708047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-7e9d6535-6dc6-4ba3-920d-044d78f9b3b1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:25.708701 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-7e9d6535-6dc6-4ba3-920d-044d78f9b3b1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:25.719532 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7e9d6535-6dc6-4ba3-920d-044d78f9b3b1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:25.725613 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7e9d6535-6dc6-4ba3-920d-044d78f9b3b1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:25.725613 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7e9d6535-6dc6-4ba3-920d-044d78f9b3b1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:25.725613 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7e9d6535-6dc6-4ba3-920d-044d78f9b3b1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:25.725613 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7e9d6535-6dc6-4ba3-920d-044d78f9b3b1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:25.726207 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7e9d6535-6dc6-4ba3-920d-044d78f9b3b1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:25.854523 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a01c8965-1eb2-43dd-aacf-b5adb7c3345b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:25.855410 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a01c8965-1eb2-43dd-aacf-b5adb7c3345b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:25.864269 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a01c8965-1eb2-43dd-aacf-b5adb7c3345b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:25.869136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a01c8965-1eb2-43dd-aacf-b5adb7c3345b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:25.869136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a01c8965-1eb2-43dd-aacf-b5adb7c3345b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:25.869136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a01c8965-1eb2-43dd-aacf-b5adb7c3345b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:25.869136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a01c8965-1eb2-43dd-aacf-b5adb7c3345b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:25.869557 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a01c8965-1eb2-43dd-aacf-b5adb7c3345b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:26.006521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-7e9d6535-6dc6-4ba3-920d-044d78f9b3b1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:26.028238 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-7e9d6535-6dc6-4ba3-920d-044d78f9b3b1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:26.032570 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-7e9d6535-6dc6-4ba3-920d-044d78f9b3b1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:26.034956 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-7e9d6535-6dc6-4ba3-920d-044d78f9b3b1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1725 microversion: 2.20 time: 0.331080 Aug 24 13:40:26.035809 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 106/209] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:25 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1725 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:26.118215 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a01c8965-1eb2-43dd-aacf-b5adb7c3345b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:26.129934 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a01c8965-1eb2-43dd-aacf-b5adb7c3345b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1322 microversion: 2.1 time: 0.279854 Aug 24 13:40:26.139029 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 104/210] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:25 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:26.482033 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-2237fc3a-a461-4711-a495-d560b908e538 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:26.483280 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-2237fc3a-a461-4711-a495-d560b908e538 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:26.489831 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2237fc3a-a461-4711-a495-d560b908e538 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:26.490413 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2237fc3a-a461-4711-a495-d560b908e538 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:26.490929 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2237fc3a-a461-4711-a495-d560b908e538 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:26.491838 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2237fc3a-a461-4711-a495-d560b908e538 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:26.492544 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2237fc3a-a461-4711-a495-d560b908e538 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:26.493047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2237fc3a-a461-4711-a495-d560b908e538 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:26.498048 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:40:26.586764 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2237fc3a-a461-4711-a495-d560b908e538 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:26.600975 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-2237fc3a-a461-4711-a495-d560b908e538 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 200 len: 1271 microversion: 2.1 time: 0.123503 Aug 24 13:40:26.601563 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 107/211] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:26 2022] GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 1271 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:40:27.061188 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-f7c915e5-61cc-4c67-a25c-6f3fa343811f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:27.061831 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-f7c915e5-61cc-4c67-a25c-6f3fa343811f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:27.069842 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f7c915e5-61cc-4c67-a25c-6f3fa343811f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:27.070641 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f7c915e5-61cc-4c67-a25c-6f3fa343811f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:27.070813 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f7c915e5-61cc-4c67-a25c-6f3fa343811f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:27.071484 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f7c915e5-61cc-4c67-a25c-6f3fa343811f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:27.071936 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f7c915e5-61cc-4c67-a25c-6f3fa343811f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:27.072991 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f7c915e5-61cc-4c67-a25c-6f3fa343811f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:27.158254 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-dcf47338-fa86-410c-9676-91d00dd8dfcd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:27.160363 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-dcf47338-fa86-410c-9676-91d00dd8dfcd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:27.175039 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dcf47338-fa86-410c-9676-91d00dd8dfcd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:27.175651 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dcf47338-fa86-410c-9676-91d00dd8dfcd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:27.178666 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dcf47338-fa86-410c-9676-91d00dd8dfcd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:27.180869 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dcf47338-fa86-410c-9676-91d00dd8dfcd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:27.181523 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dcf47338-fa86-410c-9676-91d00dd8dfcd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:27.182253 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dcf47338-fa86-410c-9676-91d00dd8dfcd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:27.338105 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-f7c915e5-61cc-4c67-a25c-6f3fa343811f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:27.350392 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-f7c915e5-61cc-4c67-a25c-6f3fa343811f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:27.352013 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-f7c915e5-61cc-4c67-a25c-6f3fa343811f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:27.353281 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-f7c915e5-61cc-4c67-a25c-6f3fa343811f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1725 microversion: 2.20 time: 0.297337 Aug 24 13:40:27.354490 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 105/212] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:27 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1725 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:40:27.395271 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-dcf47338-fa86-410c-9676-91d00dd8dfcd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:27.403262 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-dcf47338-fa86-410c-9676-91d00dd8dfcd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1322 microversion: 2.1 time: 0.253547 Aug 24 13:40:27.403847 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 108/213] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:27 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:40:27.414213 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-4ba0bd6c-31cf-46d3-9459-2807de5d3614 req-779136d7-f2ef-4e27-94c7-ae0efa4df229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbe90b5c-a710-43ee-b3a8-773a37849056", "tag": "19cbe24e-f4f7-4309-aa0c-30c3342c1d7c"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:40:27.433129 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-4ba0bd6c-31cf-46d3-9459-2807de5d3614 req-779136d7-f2ef-4e27-94c7-ae0efa4df229 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:27.434547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-4ba0bd6c-31cf-46d3-9459-2807de5d3614 req-779136d7-f2ef-4e27-94c7-ae0efa4df229 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:27.435189 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-4ba0bd6c-31cf-46d3-9459-2807de5d3614 req-779136d7-f2ef-4e27-94c7-ae0efa4df229 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:27.470143 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-4ba0bd6c-31cf-46d3-9459-2807de5d3614 req-779136d7-f2ef-4e27-94c7-ae0efa4df229 service nova] Creating event network-changed:19cbe24e-f4f7-4309-aa0c-30c3342c1d7c for instance fbe90b5c-a710-43ee-b3a8-773a37849056 on hv-cinder-77957 Aug 24 13:40:27.486870 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-4ba0bd6c-31cf-46d3-9459-2807de5d3614 req-779136d7-f2ef-4e27-94c7-ae0efa4df229 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076035 Aug 24 13:40:27.493272 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 106/214] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:40:27.624219 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b98b54c0-55c8-4c89-b36c-7ff55e143501 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:27.624860 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b98b54c0-55c8-4c89-b36c-7ff55e143501 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:27.633939 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b98b54c0-55c8-4c89-b36c-7ff55e143501 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:27.634390 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b98b54c0-55c8-4c89-b36c-7ff55e143501 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:27.638726 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b98b54c0-55c8-4c89-b36c-7ff55e143501 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:27.639665 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b98b54c0-55c8-4c89-b36c-7ff55e143501 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:27.642100 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b98b54c0-55c8-4c89-b36c-7ff55e143501 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:27.648655 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b98b54c0-55c8-4c89-b36c-7ff55e143501 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:27.839058 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b98b54c0-55c8-4c89-b36c-7ff55e143501 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:27.851122 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b98b54c0-55c8-4c89-b36c-7ff55e143501 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 200 len: 1313 microversion: 2.1 time: 0.231247 Aug 24 13:40:27.858018 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 109/215] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:27 2022] GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:28.380102 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-3e2bae56-96f8-40da-bd3b-a3e6c1ef6bf7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:28.381740 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-3e2bae56-96f8-40da-bd3b-a3e6c1ef6bf7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:28.383829 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=4 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:40:28.389911 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3e2bae56-96f8-40da-bd3b-a3e6c1ef6bf7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:28.390849 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3e2bae56-96f8-40da-bd3b-a3e6c1ef6bf7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:28.391356 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3e2bae56-96f8-40da-bd3b-a3e6c1ef6bf7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:28.392142 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3e2bae56-96f8-40da-bd3b-a3e6c1ef6bf7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:28.392700 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3e2bae56-96f8-40da-bd3b-a3e6c1ef6bf7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:28.393453 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3e2bae56-96f8-40da-bd3b-a3e6c1ef6bf7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:28.428524 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-40a21337-b202-465e-8c1e-9a45857da52e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:28.429916 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-40a21337-b202-465e-8c1e-9a45857da52e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:28.434276 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=2 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:40:28.438665 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-40a21337-b202-465e-8c1e-9a45857da52e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:28.439574 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-40a21337-b202-465e-8c1e-9a45857da52e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:28.440382 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-40a21337-b202-465e-8c1e-9a45857da52e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:28.441193 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-40a21337-b202-465e-8c1e-9a45857da52e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:28.442183 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-40a21337-b202-465e-8c1e-9a45857da52e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:28.443127 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-40a21337-b202-465e-8c1e-9a45857da52e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:28.690367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3e2bae56-96f8-40da-bd3b-a3e6c1ef6bf7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:28.713241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-40a21337-b202-465e-8c1e-9a45857da52e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:28.726596 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3e2bae56-96f8-40da-bd3b-a3e6c1ef6bf7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:28.729993 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3e2bae56-96f8-40da-bd3b-a3e6c1ef6bf7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:28.732852 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-40a21337-b202-465e-8c1e-9a45857da52e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1322 microversion: 2.1 time: 0.307002 Aug 24 13:40:28.732852 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 110/216] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:28 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:28.738269 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-3e2bae56-96f8-40da-bd3b-a3e6c1ef6bf7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1725 microversion: 2.20 time: 0.359485 Aug 24 13:40:28.740590 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 107/217] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:28 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1725 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:28.873620 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b0586bb1-1e41-470d-9f21-2ec90cc17764 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:28.874251 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b0586bb1-1e41-470d-9f21-2ec90cc17764 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:28.880910 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b0586bb1-1e41-470d-9f21-2ec90cc17764 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:28.881401 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b0586bb1-1e41-470d-9f21-2ec90cc17764 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:28.881839 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b0586bb1-1e41-470d-9f21-2ec90cc17764 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:28.882660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b0586bb1-1e41-470d-9f21-2ec90cc17764 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:28.883118 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b0586bb1-1e41-470d-9f21-2ec90cc17764 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:28.883544 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b0586bb1-1e41-470d-9f21-2ec90cc17764 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:29.135383 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b0586bb1-1e41-470d-9f21-2ec90cc17764 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:29.147160 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b0586bb1-1e41-470d-9f21-2ec90cc17764 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 200 len: 1313 microversion: 2.1 time: 0.277569 Aug 24 13:40:29.148362 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 111/218] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:28 2022] GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:40:29.513243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-27d057fb-501d-477f-8d20-b38da1e62b04 req-84ab9a49-f963-4445-9528-5cc9ce220818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46ffe8c1-ef80-42b6-aa3c-6f60ceea267b", "tag": "217d6ecd-1ec6-4895-adb9-790e971bf720"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:40:29.525758 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-27d057fb-501d-477f-8d20-b38da1e62b04 req-84ab9a49-f963-4445-9528-5cc9ce220818 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:29.526234 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-27d057fb-501d-477f-8d20-b38da1e62b04 req-84ab9a49-f963-4445-9528-5cc9ce220818 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:29.531299 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-27d057fb-501d-477f-8d20-b38da1e62b04 req-84ab9a49-f963-4445-9528-5cc9ce220818 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:29.557861 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-27d057fb-501d-477f-8d20-b38da1e62b04 req-84ab9a49-f963-4445-9528-5cc9ce220818 service nova] Creating event network-changed:217d6ecd-1ec6-4895-adb9-790e971bf720 for instance 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b on hv-cinder-77957 Aug 24 13:40:29.563905 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-27d057fb-501d-477f-8d20-b38da1e62b04 req-84ab9a49-f963-4445-9528-5cc9ce220818 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053948 Aug 24 13:40:29.564755 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 108/219] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:40:29.765427 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-63a07c7e-469c-40eb-8410-589b16f63b3f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:29.766685 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-63a07c7e-469c-40eb-8410-589b16f63b3f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:29.774954 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-63a07c7e-469c-40eb-8410-589b16f63b3f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:29.775680 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-63a07c7e-469c-40eb-8410-589b16f63b3f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:29.776814 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-63a07c7e-469c-40eb-8410-589b16f63b3f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:29.777776 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-63a07c7e-469c-40eb-8410-589b16f63b3f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:29.778953 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-63a07c7e-469c-40eb-8410-589b16f63b3f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:29.780091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-63a07c7e-469c-40eb-8410-589b16f63b3f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:29.781533 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-2f8885ae-0087-4565-851b-40c5b61f4851 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:29.782601 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-2f8885ae-0087-4565-851b-40c5b61f4851 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:29.796921 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2f8885ae-0087-4565-851b-40c5b61f4851 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:29.796921 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2f8885ae-0087-4565-851b-40c5b61f4851 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:29.796921 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2f8885ae-0087-4565-851b-40c5b61f4851 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:29.796921 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2f8885ae-0087-4565-851b-40c5b61f4851 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:29.797418 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2f8885ae-0087-4565-851b-40c5b61f4851 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:29.797418 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2f8885ae-0087-4565-851b-40c5b61f4851 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:29.801154 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=100 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:40:29.848088 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=12 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:40:30.039459 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-2f8885ae-0087-4565-851b-40c5b61f4851 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:30.053956 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-2f8885ae-0087-4565-851b-40c5b61f4851 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:30.055563 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-2f8885ae-0087-4565-851b-40c5b61f4851 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:30.056881 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-2f8885ae-0087-4565-851b-40c5b61f4851 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1746 microversion: 2.20 time: 0.283144 Aug 24 13:40:30.063924 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 109/220] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:29 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1746 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:30.077744 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-63a07c7e-469c-40eb-8410-589b16f63b3f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:30.087541 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-453bddd0-ea63-482d-a61a-b4e9aa96de1b req-35f98947-f778-402e-bc9a-00f51eb6c821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08ba9691-685f-444a-9c86-9ac1562acbf0", "name": "network-vif-plugged", "status": "completed", "tag": "88ef4e43-75b6-482c-8852-e8293b84a9ab"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:40:30.108666 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-63a07c7e-469c-40eb-8410-589b16f63b3f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1322 microversion: 2.1 time: 0.346190 Aug 24 13:40:30.109662 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 112/221] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:29 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1322 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:30.117294 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-5b34a077-25df-4976-8300-55930a66d2d3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1236927942", "imageRef": "c520113c-3dae-4490-98bb-19fe3a46b66d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "789a27f6-7f62-4022-86ef-1042c82fc322"}], "security_groups": [{"name": "tempest-securitygroup--424436327"}], "key_name": "tempest-keypair-1348800994", "user_data": "}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:40:30.117793 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-453bddd0-ea63-482d-a61a-b4e9aa96de1b req-35f98947-f778-402e-bc9a-00f51eb6c821 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:30.120798 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-453bddd0-ea63-482d-a61a-b4e9aa96de1b req-35f98947-f778-402e-bc9a-00f51eb6c821 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:30.121273 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-453bddd0-ea63-482d-a61a-b4e9aa96de1b req-35f98947-f778-402e-bc9a-00f51eb6c821 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:30.148679 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-453bddd0-ea63-482d-a61a-b4e9aa96de1b req-35f98947-f778-402e-bc9a-00f51eb6c821 service nova] Creating event network-vif-plugged:88ef4e43-75b6-482c-8852-e8293b84a9ab for instance 08ba9691-685f-444a-9c86-9ac1562acbf0 on hv-cinder-77957 Aug 24 13:40:30.158093 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-453bddd0-ea63-482d-a61a-b4e9aa96de1b req-35f98947-f778-402e-bc9a-00f51eb6c821 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086192 Aug 24 13:40:30.159514 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 110/222] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:40:30.176979 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-9fb8181b-fc65-4d9d-83a0-8ad90bb7b7a6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:30.177746 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-9fb8181b-fc65-4d9d-83a0-8ad90bb7b7a6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:30.188446 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9fb8181b-fc65-4d9d-83a0-8ad90bb7b7a6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:30.188956 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9fb8181b-fc65-4d9d-83a0-8ad90bb7b7a6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:30.189391 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9fb8181b-fc65-4d9d-83a0-8ad90bb7b7a6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:30.190190 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9fb8181b-fc65-4d9d-83a0-8ad90bb7b7a6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:30.190671 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9fb8181b-fc65-4d9d-83a0-8ad90bb7b7a6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:30.191096 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9fb8181b-fc65-4d9d-83a0-8ad90bb7b7a6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:30.285661 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.network.neutron [None req-5b34a077-25df-4976-8300-55930a66d2d3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] validate_networks() for [('789a27f6-7f62-4022-86ef-1042c82fc322', None, None, None, None, None)] {{(pid=133015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:40:30.428488 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-9fb8181b-fc65-4d9d-83a0-8ad90bb7b7a6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:30.450627 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-9fb8181b-fc65-4d9d-83a0-8ad90bb7b7a6 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 200 len: 1313 microversion: 2.1 time: 0.280887 Aug 24 13:40:30.461015 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 111/223] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:30 2022] GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:30.828083 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-5b34a077-25df-4976-8300-55930a66d2d3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Flavor limits 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:40:30.829160 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-5b34a077-25df-4976-8300-55930a66d2d3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Image limits 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:40:30.829653 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-5b34a077-25df-4976-8300-55930a66d2d3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Flavor pref 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:40:30.830071 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-5b34a077-25df-4976-8300-55930a66d2d3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Image pref 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:40:30.830490 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-5b34a077-25df-4976-8300-55930a66d2d3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:40:30.844653 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5b34a077-25df-4976-8300-55930a66d2d3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:30.845636 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5b34a077-25df-4976-8300-55930a66d2d3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:30.846432 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5b34a077-25df-4976-8300-55930a66d2d3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:30.847477 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5b34a077-25df-4976-8300-55930a66d2d3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:30.848330 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5b34a077-25df-4976-8300-55930a66d2d3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:30.849186 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5b34a077-25df-4976-8300-55930a66d2d3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:30.873914 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-5b34a077-25df-4976-8300-55930a66d2d3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Getting quotas for project 019b2e8bdb934d94a25fe4b355e73c68. Resources: {'instances', 'cores', 'ram'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:40:30.879369 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-5b34a077-25df-4976-8300-55930a66d2d3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Getting quotas for user ea9d4eafe59c4c8180eece8ec9283e40 and project 019b2e8bdb934d94a25fe4b355e73c68. Resources: {'instances', 'cores', 'ram'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:40:30.893675 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-5b34a077-25df-4976-8300-55930a66d2d3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Going to run 1 instances... {{(pid=133015) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 13:40:30.896679 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-5b34a077-25df-4976-8300-55930a66d2d3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c520113c-3dae-4490-98bb-19fe3a46b66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 13:40:31.112254 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-986f2cfd-6f2e-4334-a0fa-ffa016cf86d5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:31.113437 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-986f2cfd-6f2e-4334-a0fa-ffa016cf86d5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:31.116487 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-5b34a077-25df-4976-8300-55930a66d2d3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.005321 Aug 24 13:40:31.117819 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 113/224] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 13:40:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 13:40:31.123360 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-986f2cfd-6f2e-4334-a0fa-ffa016cf86d5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:31.124090 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-986f2cfd-6f2e-4334-a0fa-ffa016cf86d5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:31.126453 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-986f2cfd-6f2e-4334-a0fa-ffa016cf86d5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:31.127466 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-986f2cfd-6f2e-4334-a0fa-ffa016cf86d5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:31.130123 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-986f2cfd-6f2e-4334-a0fa-ffa016cf86d5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:31.130673 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-986f2cfd-6f2e-4334-a0fa-ffa016cf86d5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:31.146852 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-cd0048cf-401c-40bf-b93d-17ba176ae0a1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:31.157979 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-cd0048cf-401c-40bf-b93d-17ba176ae0a1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:31.243658 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-cd0048cf-401c-40bf-b93d-17ba176ae0a1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:31.251586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-cd0048cf-401c-40bf-b93d-17ba176ae0a1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6" status: 200 len: 1242 microversion: 2.1 time: 0.111964 Aug 24 13:40:31.252426 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 114/225] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:31 2022] GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 => generated 1242 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:31.307815 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-c54e3d72-30b5-44e4-b1a9-3c2375f4d30c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:31.307815 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-c54e3d72-30b5-44e4-b1a9-3c2375f4d30c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:31.330508 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c54e3d72-30b5-44e4-b1a9-3c2375f4d30c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:31.332414 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c54e3d72-30b5-44e4-b1a9-3c2375f4d30c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:31.333221 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c54e3d72-30b5-44e4-b1a9-3c2375f4d30c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:31.339796 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c54e3d72-30b5-44e4-b1a9-3c2375f4d30c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:31.340659 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c54e3d72-30b5-44e4-b1a9-3c2375f4d30c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:31.342606 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c54e3d72-30b5-44e4-b1a9-3c2375f4d30c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:31.361504 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-986f2cfd-6f2e-4334-a0fa-ffa016cf86d5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:31.372690 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-986f2cfd-6f2e-4334-a0fa-ffa016cf86d5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:31.376648 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-986f2cfd-6f2e-4334-a0fa-ffa016cf86d5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:31.381470 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-986f2cfd-6f2e-4334-a0fa-ffa016cf86d5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1746 microversion: 2.20 time: 0.280285 Aug 24 13:40:31.383724 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 112/226] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:31 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1746 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:31.474703 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-4578c4d2-41b7-4332-895e-928a6d107289 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:31.475524 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-4578c4d2-41b7-4332-895e-928a6d107289 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:31.488673 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4578c4d2-41b7-4332-895e-928a6d107289 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:31.491061 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4578c4d2-41b7-4332-895e-928a6d107289 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:31.492403 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4578c4d2-41b7-4332-895e-928a6d107289 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:31.493985 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4578c4d2-41b7-4332-895e-928a6d107289 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:31.495435 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4578c4d2-41b7-4332-895e-928a6d107289 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:31.496531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4578c4d2-41b7-4332-895e-928a6d107289 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:31.583633 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c54e3d72-30b5-44e4-b1a9-3c2375f4d30c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:31.593051 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-c54e3d72-30b5-44e4-b1a9-3c2375f4d30c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1322 microversion: 2.1 time: 0.339413 Aug 24 13:40:31.593905 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 115/227] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:31 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1322 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:31.747444 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-4578c4d2-41b7-4332-895e-928a6d107289 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:31.763101 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-4578c4d2-41b7-4332-895e-928a6d107289 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 200 len: 1313 microversion: 2.1 time: 0.292528 Aug 24 13:40:31.764024 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 113/228] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:31 2022] GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:32.180059 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-bb28d1d9-e48f-45e8-b1ef-fc5c291178ac req-e4c509fe-1743-4bbd-a4f9-d8ba5b4c79cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53bade32-e7bf-4ace-9b68-0458f257feff", "name": "network-vif-plugged", "status": "completed", "tag": "55484e25-34c8-469b-8598-d718e9469013"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:40:32.190927 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-bb28d1d9-e48f-45e8-b1ef-fc5c291178ac req-e4c509fe-1743-4bbd-a4f9-d8ba5b4c79cb service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:32.191404 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-bb28d1d9-e48f-45e8-b1ef-fc5c291178ac req-e4c509fe-1743-4bbd-a4f9-d8ba5b4c79cb service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:32.191826 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-bb28d1d9-e48f-45e8-b1ef-fc5c291178ac req-e4c509fe-1743-4bbd-a4f9-d8ba5b4c79cb service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:32.204070 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-bb28d1d9-e48f-45e8-b1ef-fc5c291178ac req-e4c509fe-1743-4bbd-a4f9-d8ba5b4c79cb service nova] Creating event network-vif-plugged:55484e25-34c8-469b-8598-d718e9469013 for instance 53bade32-e7bf-4ace-9b68-0458f257feff on hv-cinder-77957 Aug 24 13:40:32.209392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-bb28d1d9-e48f-45e8-b1ef-fc5c291178ac req-e4c509fe-1743-4bbd-a4f9-d8ba5b4c79cb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034242 Aug 24 13:40:32.209993 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 116/229] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:40:32.291627 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-1675f91c-8387-433d-9c26-c9947c07bdd3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:32.292299 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-1675f91c-8387-433d-9c26-c9947c07bdd3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:32.299715 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1675f91c-8387-433d-9c26-c9947c07bdd3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:32.300294 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1675f91c-8387-433d-9c26-c9947c07bdd3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:32.300740 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1675f91c-8387-433d-9c26-c9947c07bdd3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:32.301451 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1675f91c-8387-433d-9c26-c9947c07bdd3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:32.302111 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1675f91c-8387-433d-9c26-c9947c07bdd3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:32.302544 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1675f91c-8387-433d-9c26-c9947c07bdd3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:32.411610 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-2d373b3f-13d0-4fbd-8bf7-b8648f2fea5a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:32.412922 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-2d373b3f-13d0-4fbd-8bf7-b8648f2fea5a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:32.420387 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2d373b3f-13d0-4fbd-8bf7-b8648f2fea5a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:32.421173 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2d373b3f-13d0-4fbd-8bf7-b8648f2fea5a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:32.421810 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2d373b3f-13d0-4fbd-8bf7-b8648f2fea5a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:32.422924 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2d373b3f-13d0-4fbd-8bf7-b8648f2fea5a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:32.423565 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2d373b3f-13d0-4fbd-8bf7-b8648f2fea5a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:32.424142 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2d373b3f-13d0-4fbd-8bf7-b8648f2fea5a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:32.547912 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-1675f91c-8387-433d-9c26-c9947c07bdd3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:32.559477 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-1675f91c-8387-433d-9c26-c9947c07bdd3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6" status: 200 len: 1246 microversion: 2.1 time: 0.271881 Aug 24 13:40:32.560067 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 114/230] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:32 2022] GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 => generated 1246 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:40:32.616020 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e42796cb-ec2f-4a19-9cdd-5f3d2b408fb2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:32.616749 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-e42796cb-ec2f-4a19-9cdd-5f3d2b408fb2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:32.627191 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e42796cb-ec2f-4a19-9cdd-5f3d2b408fb2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:32.628095 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e42796cb-ec2f-4a19-9cdd-5f3d2b408fb2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:32.629438 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e42796cb-ec2f-4a19-9cdd-5f3d2b408fb2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:32.632080 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e42796cb-ec2f-4a19-9cdd-5f3d2b408fb2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:32.632687 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e42796cb-ec2f-4a19-9cdd-5f3d2b408fb2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:32.633677 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e42796cb-ec2f-4a19-9cdd-5f3d2b408fb2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:32.870775 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2d373b3f-13d0-4fbd-8bf7-b8648f2fea5a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:32.887739 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2d373b3f-13d0-4fbd-8bf7-b8648f2fea5a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:32.890558 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2d373b3f-13d0-4fbd-8bf7-b8648f2fea5a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:32.892170 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-2d373b3f-13d0-4fbd-8bf7-b8648f2fea5a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1741 microversion: 2.20 time: 0.487950 Aug 24 13:40:32.893330 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 117/231] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:32 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1741 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:40:32.913050 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-adb02ce7-5ee0-4eae-9630-a08d0454907e tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:32.913750 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-adb02ce7-5ee0-4eae-9630-a08d0454907e tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:32.924616 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-adb02ce7-5ee0-4eae-9630-a08d0454907e tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:32.925445 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-adb02ce7-5ee0-4eae-9630-a08d0454907e tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:32.926042 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-adb02ce7-5ee0-4eae-9630-a08d0454907e tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:32.926903 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-adb02ce7-5ee0-4eae-9630-a08d0454907e tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:32.927632 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-adb02ce7-5ee0-4eae-9630-a08d0454907e tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:32.928879 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-adb02ce7-5ee0-4eae-9630-a08d0454907e tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:33.025229 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e42796cb-ec2f-4a19-9cdd-5f3d2b408fb2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:33.034459 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-e42796cb-ec2f-4a19-9cdd-5f3d2b408fb2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1322 microversion: 2.1 time: 0.423423 Aug 24 13:40:33.045032 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 115/232] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:32 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1322 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:33.182203 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-adb02ce7-5ee0-4eae-9630-a08d0454907e tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:33.208875 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-adb02ce7-5ee0-4eae-9630-a08d0454907e tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 200 len: 1313 microversion: 2.1 time: 0.314084 Aug 24 13:40:33.209521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 118/233] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:32 2022] GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:33.584038 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-8b9df92b-88bc-4759-96a1-a51b08d1bcaa tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:33.585622 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-8b9df92b-88bc-4759-96a1-a51b08d1bcaa tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:33.598013 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8b9df92b-88bc-4759-96a1-a51b08d1bcaa tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:33.604985 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8b9df92b-88bc-4759-96a1-a51b08d1bcaa tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:33.605736 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8b9df92b-88bc-4759-96a1-a51b08d1bcaa tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:33.606495 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8b9df92b-88bc-4759-96a1-a51b08d1bcaa tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:33.606969 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8b9df92b-88bc-4759-96a1-a51b08d1bcaa tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:33.607402 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8b9df92b-88bc-4759-96a1-a51b08d1bcaa tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:33.710684 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-8b9df92b-88bc-4759-96a1-a51b08d1bcaa tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:33.746453 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-8b9df92b-88bc-4759-96a1-a51b08d1bcaa tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6" status: 200 len: 1238 microversion: 2.1 time: 0.167911 Aug 24 13:40:33.757188 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 116/234] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:33 2022] GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 => generated 1238 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:33.921264 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-c586d104-6b1d-42da-b09f-00c4ce8ae372 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:33.930897 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-c586d104-6b1d-42da-b09f-00c4ce8ae372 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:33.962530 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c586d104-6b1d-42da-b09f-00c4ce8ae372 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:33.964775 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c586d104-6b1d-42da-b09f-00c4ce8ae372 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:33.968387 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c586d104-6b1d-42da-b09f-00c4ce8ae372 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:33.975336 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c586d104-6b1d-42da-b09f-00c4ce8ae372 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:33.977676 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c586d104-6b1d-42da-b09f-00c4ce8ae372 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:33.978879 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c586d104-6b1d-42da-b09f-00c4ce8ae372 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:34.058498 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-3a9b1ff9-58fa-4076-b769-3b68820200ef tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:34.059667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-3a9b1ff9-58fa-4076-b769-3b68820200ef tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:34.073290 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3a9b1ff9-58fa-4076-b769-3b68820200ef tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:34.078360 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3a9b1ff9-58fa-4076-b769-3b68820200ef tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:34.078987 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3a9b1ff9-58fa-4076-b769-3b68820200ef tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:34.080017 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3a9b1ff9-58fa-4076-b769-3b68820200ef tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:34.080700 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3a9b1ff9-58fa-4076-b769-3b68820200ef tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:34.094648 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3a9b1ff9-58fa-4076-b769-3b68820200ef tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:34.483545 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3a9b1ff9-58fa-4076-b769-3b68820200ef tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:34.498463 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-3a9b1ff9-58fa-4076-b769-3b68820200ef tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1322 microversion: 2.1 time: 0.444436 Aug 24 13:40:34.499620 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 117/235] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:34 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1322 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:40:34.505378 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-fdf47a8c-425d-4113-9fa7-13eda994dfa0 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:34.508362 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-fdf47a8c-425d-4113-9fa7-13eda994dfa0 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:34.536456 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fdf47a8c-425d-4113-9fa7-13eda994dfa0 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:34.537145 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fdf47a8c-425d-4113-9fa7-13eda994dfa0 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:34.537748 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fdf47a8c-425d-4113-9fa7-13eda994dfa0 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:34.538764 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fdf47a8c-425d-4113-9fa7-13eda994dfa0 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:34.542906 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fdf47a8c-425d-4113-9fa7-13eda994dfa0 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:34.543619 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fdf47a8c-425d-4113-9fa7-13eda994dfa0 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:34.593550 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c586d104-6b1d-42da-b09f-00c4ce8ae372 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:34.642920 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=20 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:40:34.659203 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c586d104-6b1d-42da-b09f-00c4ce8ae372 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:34.662882 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c586d104-6b1d-42da-b09f-00c4ce8ae372 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:34.672672 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-c586d104-6b1d-42da-b09f-00c4ce8ae372 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1741 microversion: 2.20 time: 0.755326 Aug 24 13:40:34.674756 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 119/236] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:33 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1741 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:34.693319 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-111eaaf7-7ff7-4c8b-bd22-a36fe11b8143 req-2ffcc0c5-ec87-4bf3-a727-c3185256bbcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe90b5c-a710-43ee-b3a8-773a37849056", "name": "network-vif-plugged", "status": "completed", "tag": "19cbe24e-f4f7-4309-aa0c-30c3342c1d7c"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:40:34.740099 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-111eaaf7-7ff7-4c8b-bd22-a36fe11b8143 req-2ffcc0c5-ec87-4bf3-a727-c3185256bbcc service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:34.743412 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-111eaaf7-7ff7-4c8b-bd22-a36fe11b8143 req-2ffcc0c5-ec87-4bf3-a727-c3185256bbcc service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:34.757926 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-111eaaf7-7ff7-4c8b-bd22-a36fe11b8143 req-2ffcc0c5-ec87-4bf3-a727-c3185256bbcc service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:34.811952 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-111eaaf7-7ff7-4c8b-bd22-a36fe11b8143 req-2ffcc0c5-ec87-4bf3-a727-c3185256bbcc service nova] Creating event network-vif-plugged:19cbe24e-f4f7-4309-aa0c-30c3342c1d7c for instance fbe90b5c-a710-43ee-b3a8-773a37849056 on hv-cinder-77957 Aug 24 13:40:34.830994 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-fdf47a8c-425d-4113-9fa7-13eda994dfa0 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:34.848202 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-fdf47a8c-425d-4113-9fa7-13eda994dfa0 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 200 len: 1313 microversion: 2.1 time: 0.346679 Aug 24 13:40:34.849141 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 118/237] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:34 2022] GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:34.856329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a59e92db-3780-480f-8aed-bf086ec2e188 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:34.857231 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a59e92db-3780-480f-8aed-bf086ec2e188 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:34.858145 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-111eaaf7-7ff7-4c8b-bd22-a36fe11b8143 req-2ffcc0c5-ec87-4bf3-a727-c3185256bbcc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174791 Aug 24 13:40:34.862174 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 120/238] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:40:34.871600 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a59e92db-3780-480f-8aed-bf086ec2e188 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:34.873756 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a59e92db-3780-480f-8aed-bf086ec2e188 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:34.873958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a59e92db-3780-480f-8aed-bf086ec2e188 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:34.874919 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a59e92db-3780-480f-8aed-bf086ec2e188 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:34.875542 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a59e92db-3780-480f-8aed-bf086ec2e188 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:34.876745 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a59e92db-3780-480f-8aed-bf086ec2e188 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:34.973501 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a59e92db-3780-480f-8aed-bf086ec2e188 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:34.987012 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a59e92db-3780-480f-8aed-bf086ec2e188 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6" status: 200 len: 1294 microversion: 2.1 time: 0.136269 Aug 24 13:40:34.996359 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 119/239] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:34 2022] GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 => generated 1294 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:35.547727 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-1a606bc1-b6a0-4b15-aec2-806961df5087 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:35.548943 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-1a606bc1-b6a0-4b15-aec2-806961df5087 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:35.616148 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1a606bc1-b6a0-4b15-aec2-806961df5087 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:35.617189 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1a606bc1-b6a0-4b15-aec2-806961df5087 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:35.619523 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1a606bc1-b6a0-4b15-aec2-806961df5087 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:35.622157 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1a606bc1-b6a0-4b15-aec2-806961df5087 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:35.625998 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1a606bc1-b6a0-4b15-aec2-806961df5087 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:35.626469 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1a606bc1-b6a0-4b15-aec2-806961df5087 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:35.728150 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-0fb1b7cc-ac16-418a-80f6-394c66945bf7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:35.741538 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-0fb1b7cc-ac16-418a-80f6-394c66945bf7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:35.804351 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0fb1b7cc-ac16-418a-80f6-394c66945bf7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:35.804351 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0fb1b7cc-ac16-418a-80f6-394c66945bf7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:35.804351 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0fb1b7cc-ac16-418a-80f6-394c66945bf7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:35.804351 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0fb1b7cc-ac16-418a-80f6-394c66945bf7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:35.804786 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0fb1b7cc-ac16-418a-80f6-394c66945bf7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:35.807064 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0fb1b7cc-ac16-418a-80f6-394c66945bf7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:36.405444 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-1a606bc1-b6a0-4b15-aec2-806961df5087 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:36.421757 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-1a606bc1-b6a0-4b15-aec2-806961df5087 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1322 microversion: 2.1 time: 0.886433 Aug 24 13:40:36.423259 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 121/240] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:35 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1322 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:40:36.433740 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-3f98ea22-9639-4082-89e8-74a393d7d64b tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:36.464633 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-3f98ea22-9639-4082-89e8-74a393d7d64b tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:36.491885 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3f98ea22-9639-4082-89e8-74a393d7d64b tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:36.492659 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3f98ea22-9639-4082-89e8-74a393d7d64b tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:36.494125 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3f98ea22-9639-4082-89e8-74a393d7d64b tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:36.497496 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3f98ea22-9639-4082-89e8-74a393d7d64b tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:36.498946 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3f98ea22-9639-4082-89e8-74a393d7d64b tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:36.501002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3f98ea22-9639-4082-89e8-74a393d7d64b tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:36.580375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0fb1b7cc-ac16-418a-80f6-394c66945bf7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:36.600912 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0fb1b7cc-ac16-418a-80f6-394c66945bf7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:36.620066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0fb1b7cc-ac16-418a-80f6-394c66945bf7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:36.623324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-0fb1b7cc-ac16-418a-80f6-394c66945bf7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1741 microversion: 2.20 time: 0.916476 Aug 24 13:40:36.636593 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 120/241] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:35 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1741 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:36.664768 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e2a5b3e9-45d8-42e5-b157-696c6d270977 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:36.670682 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-e2a5b3e9-45d8-42e5-b157-696c6d270977 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:36.696397 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e2a5b3e9-45d8-42e5-b157-696c6d270977 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:36.696809 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e2a5b3e9-45d8-42e5-b157-696c6d270977 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:36.700980 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e2a5b3e9-45d8-42e5-b157-696c6d270977 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:36.709754 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e2a5b3e9-45d8-42e5-b157-696c6d270977 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:36.710364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e2a5b3e9-45d8-42e5-b157-696c6d270977 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:36.714248 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e2a5b3e9-45d8-42e5-b157-696c6d270977 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:37.013714 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e2a5b3e9-45d8-42e5-b157-696c6d270977 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:37.022734 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-3f98ea22-9639-4082-89e8-74a393d7d64b tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:37.031479 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-e2a5b3e9-45d8-42e5-b157-696c6d270977 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6" status: 200 len: 1312 microversion: 2.1 time: 0.380962 Aug 24 13:40:37.033520 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 121/242] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:36 2022] GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 => generated 1312 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:37.038034 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-3f98ea22-9639-4082-89e8-74a393d7d64b tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 200 len: 1313 microversion: 2.1 time: 0.608307 Aug 24 13:40:37.038554 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 122/243] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:36 2022] GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 1313 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:37.448034 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-97557517-5dd8-4dd8-ae44-81c560d05183 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:37.448702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-97557517-5dd8-4dd8-ae44-81c560d05183 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:37.456195 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97557517-5dd8-4dd8-ae44-81c560d05183 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:37.462055 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97557517-5dd8-4dd8-ae44-81c560d05183 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:37.464803 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97557517-5dd8-4dd8-ae44-81c560d05183 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:37.465809 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97557517-5dd8-4dd8-ae44-81c560d05183 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:37.467637 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97557517-5dd8-4dd8-ae44-81c560d05183 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:37.468352 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97557517-5dd8-4dd8-ae44-81c560d05183 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:37.670246 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-7f9ef7d2-1a07-4748-8605-a734440678e1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:37.671782 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-7f9ef7d2-1a07-4748-8605-a734440678e1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:37.691815 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7f9ef7d2-1a07-4748-8605-a734440678e1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:37.695085 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7f9ef7d2-1a07-4748-8605-a734440678e1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:37.696938 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7f9ef7d2-1a07-4748-8605-a734440678e1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:37.699392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7f9ef7d2-1a07-4748-8605-a734440678e1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:37.702305 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7f9ef7d2-1a07-4748-8605-a734440678e1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:37.703218 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7f9ef7d2-1a07-4748-8605-a734440678e1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:37.907683 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-97557517-5dd8-4dd8-ae44-81c560d05183 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:37.936304 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-97557517-5dd8-4dd8-ae44-81c560d05183 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1322 microversion: 2.1 time: 0.490218 Aug 24 13:40:37.940672 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 122/244] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:37 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1322 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:38.059913 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-061b2135-0410-4e3e-854b-8114942469ec tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:38.061421 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-061b2135-0410-4e3e-854b-8114942469ec tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:38.085444 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-061b2135-0410-4e3e-854b-8114942469ec tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:38.085768 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-061b2135-0410-4e3e-854b-8114942469ec tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:38.086216 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-061b2135-0410-4e3e-854b-8114942469ec tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:38.087097 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-061b2135-0410-4e3e-854b-8114942469ec tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:38.087475 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-061b2135-0410-4e3e-854b-8114942469ec tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:38.087871 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-061b2135-0410-4e3e-854b-8114942469ec tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:38.237830 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-061b2135-0410-4e3e-854b-8114942469ec tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:38.245489 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-7f9ef7d2-1a07-4748-8605-a734440678e1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:38.246713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-061b2135-0410-4e3e-854b-8114942469ec tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6" status: 200 len: 1300 microversion: 2.1 time: 0.191543 Aug 24 13:40:38.249097 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 123/245] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:38 2022] GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 => generated 1300 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:38.258117 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-90ebf362-370a-4919-8504-82723de1f638 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:38.258741 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-90ebf362-370a-4919-8504-82723de1f638 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:38.263777 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-7f9ef7d2-1a07-4748-8605-a734440678e1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:38.271885 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-7f9ef7d2-1a07-4748-8605-a734440678e1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:38.279801 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-90ebf362-370a-4919-8504-82723de1f638 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:38.279801 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-90ebf362-370a-4919-8504-82723de1f638 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:38.279801 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-90ebf362-370a-4919-8504-82723de1f638 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:38.279801 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-90ebf362-370a-4919-8504-82723de1f638 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:38.280251 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-90ebf362-370a-4919-8504-82723de1f638 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:38.280355 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-7f9ef7d2-1a07-4748-8605-a734440678e1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1741 microversion: 2.20 time: 0.614419 Aug 24 13:40:38.280453 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-90ebf362-370a-4919-8504-82723de1f638 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:38.280552 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 123/246] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:37 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1741 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:38.475064 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-795c783b-449e-4ad5-8646-bfbcdcf8ac88 req-dc8d5274-82c5-420d-a4e0-cb10a5e1bb0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ffe8c1-ef80-42b6-aa3c-6f60ceea267b", "name": "network-vif-plugged", "status": "completed", "tag": "217d6ecd-1ec6-4895-adb9-790e971bf720"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:40:38.499951 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-795c783b-449e-4ad5-8646-bfbcdcf8ac88 req-dc8d5274-82c5-420d-a4e0-cb10a5e1bb0b service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:38.503537 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-795c783b-449e-4ad5-8646-bfbcdcf8ac88 req-dc8d5274-82c5-420d-a4e0-cb10a5e1bb0b service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:38.504097 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-795c783b-449e-4ad5-8646-bfbcdcf8ac88 req-dc8d5274-82c5-420d-a4e0-cb10a5e1bb0b service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:38.527383 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-90ebf362-370a-4919-8504-82723de1f638 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:38.536683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-795c783b-449e-4ad5-8646-bfbcdcf8ac88 req-dc8d5274-82c5-420d-a4e0-cb10a5e1bb0b service nova] Creating event network-vif-plugged:217d6ecd-1ec6-4895-adb9-790e971bf720 for instance 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b on hv-cinder-77957 Aug 24 13:40:38.542149 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-90ebf362-370a-4919-8504-82723de1f638 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 200 len: 1313 microversion: 2.1 time: 0.289529 Aug 24 13:40:38.548112 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 124/247] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:38 2022] GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:38.563237 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-795c783b-449e-4ad5-8646-bfbcdcf8ac88 req-dc8d5274-82c5-420d-a4e0-cb10a5e1bb0b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093891 Aug 24 13:40:38.564485 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 124/248] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 24 13:40:38.963472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-3cba4e71-ae18-4b6a-b86f-7100469821c9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:38.964100 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-3cba4e71-ae18-4b6a-b86f-7100469821c9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:38.971805 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3cba4e71-ae18-4b6a-b86f-7100469821c9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:38.972779 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3cba4e71-ae18-4b6a-b86f-7100469821c9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:38.973586 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3cba4e71-ae18-4b6a-b86f-7100469821c9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:38.974541 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3cba4e71-ae18-4b6a-b86f-7100469821c9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:38.975012 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3cba4e71-ae18-4b6a-b86f-7100469821c9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:38.975630 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3cba4e71-ae18-4b6a-b86f-7100469821c9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:39.235353 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3cba4e71-ae18-4b6a-b86f-7100469821c9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:39.273840 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b36f6cc2-4cab-42d7-9d79-32c007828ea9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:39.275439 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b36f6cc2-4cab-42d7-9d79-32c007828ea9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:39.294137 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b36f6cc2-4cab-42d7-9d79-32c007828ea9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:39.294757 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b36f6cc2-4cab-42d7-9d79-32c007828ea9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:39.295218 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b36f6cc2-4cab-42d7-9d79-32c007828ea9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:39.295981 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-3cba4e71-ae18-4b6a-b86f-7100469821c9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1322 microversion: 2.1 time: 0.336674 Aug 24 13:40:39.297990 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b36f6cc2-4cab-42d7-9d79-32c007828ea9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:39.298711 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b36f6cc2-4cab-42d7-9d79-32c007828ea9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:39.300127 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 125/249] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:38 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1322 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:40:39.303407 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b36f6cc2-4cab-42d7-9d79-32c007828ea9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:39.328579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-ffd5f2e3-8d09-4242-ac0c-5adfbb8f6486 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:39.329217 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-ffd5f2e3-8d09-4242-ac0c-5adfbb8f6486 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:39.342145 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ffd5f2e3-8d09-4242-ac0c-5adfbb8f6486 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:39.345521 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ffd5f2e3-8d09-4242-ac0c-5adfbb8f6486 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:39.345521 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ffd5f2e3-8d09-4242-ac0c-5adfbb8f6486 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:39.345521 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ffd5f2e3-8d09-4242-ac0c-5adfbb8f6486 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:39.345521 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ffd5f2e3-8d09-4242-ac0c-5adfbb8f6486 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:39.345945 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ffd5f2e3-8d09-4242-ac0c-5adfbb8f6486 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:39.388025 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=100 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:40:39.751910 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b36f6cc2-4cab-42d7-9d79-32c007828ea9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:39.770481 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b36f6cc2-4cab-42d7-9d79-32c007828ea9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6" status: 200 len: 1367 microversion: 2.1 time: 0.501095 Aug 24 13:40:39.774837 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 125/250] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:39 2022] GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 => generated 1367 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:39.797435 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-cb3d2074-bc0c-41bb-a123-b33200554963 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:39.797435 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-cb3d2074-bc0c-41bb-a123-b33200554963 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:39.806966 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cb3d2074-bc0c-41bb-a123-b33200554963 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:39.809471 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cb3d2074-bc0c-41bb-a123-b33200554963 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:39.811379 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cb3d2074-bc0c-41bb-a123-b33200554963 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:39.813088 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cb3d2074-bc0c-41bb-a123-b33200554963 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:39.813880 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cb3d2074-bc0c-41bb-a123-b33200554963 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:39.816391 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cb3d2074-bc0c-41bb-a123-b33200554963 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:39.900126 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-ffd5f2e3-8d09-4242-ac0c-5adfbb8f6486 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:39.914323 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-ffd5f2e3-8d09-4242-ac0c-5adfbb8f6486 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:39.917246 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-ffd5f2e3-8d09-4242-ac0c-5adfbb8f6486 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:39.919035 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-ffd5f2e3-8d09-4242-ac0c-5adfbb8f6486 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1741 microversion: 2.20 time: 0.614618 Aug 24 13:40:39.931811 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 126/251] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:39 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1741 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:40.193415 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-cb3d2074-bc0c-41bb-a123-b33200554963 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:40.208337 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-cb3d2074-bc0c-41bb-a123-b33200554963 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 200 len: 1313 microversion: 2.1 time: 0.430108 Aug 24 13:40:40.208993 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 126/252] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:39 2022] GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:40.330014 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-434d30c0-33b4-41d5-92d2-908d09f42612 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:40.332335 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-434d30c0-33b4-41d5-92d2-908d09f42612 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:40.347289 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-434d30c0-33b4-41d5-92d2-908d09f42612 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:40.347983 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-434d30c0-33b4-41d5-92d2-908d09f42612 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:40.348578 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-434d30c0-33b4-41d5-92d2-908d09f42612 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:40.352222 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-434d30c0-33b4-41d5-92d2-908d09f42612 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:40.354156 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-434d30c0-33b4-41d5-92d2-908d09f42612 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:40.355370 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-434d30c0-33b4-41d5-92d2-908d09f42612 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:40.568595 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-434d30c0-33b4-41d5-92d2-908d09f42612 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:40.578081 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-434d30c0-33b4-41d5-92d2-908d09f42612 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1516 microversion: 2.1 time: 0.259370 Aug 24 13:40:40.579884 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 127/253] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:40 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1516 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:40.622126 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-c15d8258-82e5-44d5-8cf6-3858b13fabd1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:40:40.626592 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-c15d8258-82e5-44d5-8cf6-3858b13fabd1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:40.634992 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c15d8258-82e5-44d5-8cf6-3858b13fabd1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:40.635614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c15d8258-82e5-44d5-8cf6-3858b13fabd1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:40.636135 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c15d8258-82e5-44d5-8cf6-3858b13fabd1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:40.636974 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c15d8258-82e5-44d5-8cf6-3858b13fabd1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:40.637504 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c15d8258-82e5-44d5-8cf6-3858b13fabd1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:40.638000 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c15d8258-82e5-44d5-8cf6-3858b13fabd1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:40.661427 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=100 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:40:40.673312 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.objects.instance [None req-c15d8258-82e5-44d5-8cf6-3858b13fabd1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lazy-loading 'flavor' on Instance uuid fbe90b5c-a710-43ee-b3a8-773a37849056 {{(pid=133015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:40:40.796889 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-3056eaea-1540-4815-9411-3c92f6254021 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:40.797818 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-3056eaea-1540-4815-9411-3c92f6254021 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:40.819401 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3056eaea-1540-4815-9411-3c92f6254021 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:40.823239 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3056eaea-1540-4815-9411-3c92f6254021 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:40.823855 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3056eaea-1540-4815-9411-3c92f6254021 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:40.824828 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3056eaea-1540-4815-9411-3c92f6254021 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:40.826437 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3056eaea-1540-4815-9411-3c92f6254021 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:40.826877 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3056eaea-1540-4815-9411-3c92f6254021 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:40.863763 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=2 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:40:41.171100 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3056eaea-1540-4815-9411-3c92f6254021 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:41.187930 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-3056eaea-1540-4815-9411-3c92f6254021 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6" status: 200 len: 1367 microversion: 2.1 time: 0.396179 Aug 24 13:40:41.194375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 128/254] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:40 2022] GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 => generated 1367 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:41.215400 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-35537b62-39ba-46bf-8a48-4da8c6958809 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:41.219961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-35537b62-39ba-46bf-8a48-4da8c6958809 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:41.235379 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-35537b62-39ba-46bf-8a48-4da8c6958809 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:41.240883 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-35537b62-39ba-46bf-8a48-4da8c6958809 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:41.241748 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-35537b62-39ba-46bf-8a48-4da8c6958809 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:41.242785 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-35537b62-39ba-46bf-8a48-4da8c6958809 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:41.244789 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-35537b62-39ba-46bf-8a48-4da8c6958809 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:41.248852 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-35537b62-39ba-46bf-8a48-4da8c6958809 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:41.543785 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=8 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:40:41.596038 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-35537b62-39ba-46bf-8a48-4da8c6958809 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:41.630791 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-35537b62-39ba-46bf-8a48-4da8c6958809 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:41.635383 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-35537b62-39ba-46bf-8a48-4da8c6958809 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:41.639951 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-35537b62-39ba-46bf-8a48-4da8c6958809 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1741 microversion: 2.20 time: 0.443666 Aug 24 13:40:41.641017 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 129/255] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:41 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1741 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:41.647304 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-99b82f38-cf41-4cad-b3dc-f2f5dfc6c5cf tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:41.651179 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-99b82f38-cf41-4cad-b3dc-f2f5dfc6c5cf tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:41.661911 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-99b82f38-cf41-4cad-b3dc-f2f5dfc6c5cf tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:41.664547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-99b82f38-cf41-4cad-b3dc-f2f5dfc6c5cf tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:41.667059 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-99b82f38-cf41-4cad-b3dc-f2f5dfc6c5cf tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:41.668147 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-99b82f38-cf41-4cad-b3dc-f2f5dfc6c5cf tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:41.668834 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-99b82f38-cf41-4cad-b3dc-f2f5dfc6c5cf tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:41.671726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-99b82f38-cf41-4cad-b3dc-f2f5dfc6c5cf tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:41.705799 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-c15d8258-82e5-44d5-8cf6-3858b13fabd1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "POST /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056/action" status: 200 len: 32 microversion: 2.1 time: 1.091769 Aug 24 13:40:41.707735 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 127/256] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 13:40:40 2022] POST /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056/action => generated 32 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 13:40:41.718311 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-11b9e891-ca2c-40d5-be26-23cf288a31e1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:41.721192 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-11b9e891-ca2c-40d5-be26-23cf288a31e1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:41.729652 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:40:41.752642 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-11b9e891-ca2c-40d5-be26-23cf288a31e1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:41.754089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-11b9e891-ca2c-40d5-be26-23cf288a31e1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:41.754723 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-11b9e891-ca2c-40d5-be26-23cf288a31e1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:41.755655 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-11b9e891-ca2c-40d5-be26-23cf288a31e1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:41.756434 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-11b9e891-ca2c-40d5-be26-23cf288a31e1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:41.757046 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-11b9e891-ca2c-40d5-be26-23cf288a31e1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:42.010150 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-11b9e891-ca2c-40d5-be26-23cf288a31e1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:42.015425 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-99b82f38-cf41-4cad-b3dc-f2f5dfc6c5cf tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:42.023906 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-99b82f38-cf41-4cad-b3dc-f2f5dfc6c5cf tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 200 len: 1313 microversion: 2.1 time: 0.381588 Aug 24 13:40:42.025812 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 130/257] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:41 2022] GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:42.026476 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-11b9e891-ca2c-40d5-be26-23cf288a31e1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.310226 Aug 24 13:40:42.028441 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 128/258] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:41 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:42.045549 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-730a6d9e-b087-41c9-8620-61b57b51a4ba req-c97db87e-5333-4019-8354-765b16cfba83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807615f2-1905-4a84-8a8b-574886415dc6", "tag": "6904bc03-dddb-4f6f-a036-c88fbbe8434e"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:40:42.066919 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-730a6d9e-b087-41c9-8620-61b57b51a4ba req-c97db87e-5333-4019-8354-765b16cfba83 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:42.067702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-730a6d9e-b087-41c9-8620-61b57b51a4ba req-c97db87e-5333-4019-8354-765b16cfba83 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:42.068137 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-730a6d9e-b087-41c9-8620-61b57b51a4ba req-c97db87e-5333-4019-8354-765b16cfba83 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:42.099991 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-730a6d9e-b087-41c9-8620-61b57b51a4ba req-c97db87e-5333-4019-8354-765b16cfba83 service nova] Creating event network-changed:6904bc03-dddb-4f6f-a036-c88fbbe8434e for instance 807615f2-1905-4a84-8a8b-574886415dc6 on hv-cinder-77957 Aug 24 13:40:42.106166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-730a6d9e-b087-41c9-8620-61b57b51a4ba req-c97db87e-5333-4019-8354-765b16cfba83 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078495 Aug 24 13:40:42.107492 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 131/259] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:40:42.261797 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-e9e65d03-9cb9-49b4-a8e1-bc76aa745ff5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:42.263117 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-e9e65d03-9cb9-49b4-a8e1-bc76aa745ff5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:42.281483 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e9e65d03-9cb9-49b4-a8e1-bc76aa745ff5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:42.282285 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e9e65d03-9cb9-49b4-a8e1-bc76aa745ff5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:42.283109 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e9e65d03-9cb9-49b4-a8e1-bc76aa745ff5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:42.284581 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e9e65d03-9cb9-49b4-a8e1-bc76aa745ff5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:42.285559 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e9e65d03-9cb9-49b4-a8e1-bc76aa745ff5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:42.287721 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e9e65d03-9cb9-49b4-a8e1-bc76aa745ff5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:42.513068 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-6f632094-7060-4163-9d5f-1ef2b59c02fe tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1273001341", "imageRef": "c520113c-3dae-4490-98bb-19fe3a46b66d", "flavorRef": "452"}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:40:42.681128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.network.neutron [None req-6f632094-7060-4163-9d5f-1ef2b59c02fe tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] validate_networks() for None {{(pid=133014) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:40:42.851884 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-e9e65d03-9cb9-49b4-a8e1-bc76aa745ff5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:42.865667 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-e9e65d03-9cb9-49b4-a8e1-bc76aa745ff5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6" status: 200 len: 1367 microversion: 2.1 time: 0.618972 Aug 24 13:40:42.866433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 129/260] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:42 2022] GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 => generated 1367 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:42.902200 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-2d43beb2-c1d0-491d-9788-3736d4bd199b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:42.906793 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-2d43beb2-c1d0-491d-9788-3736d4bd199b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:42.938239 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2d43beb2-c1d0-491d-9788-3736d4bd199b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:42.941888 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2d43beb2-c1d0-491d-9788-3736d4bd199b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:42.942653 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2d43beb2-c1d0-491d-9788-3736d4bd199b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:42.946995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2d43beb2-c1d0-491d-9788-3736d4bd199b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:42.947744 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2d43beb2-c1d0-491d-9788-3736d4bd199b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:42.948448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2d43beb2-c1d0-491d-9788-3736d4bd199b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:43.998677 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2d43beb2-c1d0-491d-9788-3736d4bd199b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:44.016093 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2d43beb2-c1d0-491d-9788-3736d4bd199b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:44.031531 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2d43beb2-c1d0-491d-9788-3736d4bd199b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:44.036112 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-2d43beb2-c1d0-491d-9788-3736d4bd199b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1741 microversion: 2.20 time: 1.165921 Aug 24 13:40:44.061063 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 130/261] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:42 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1741 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:44.078146 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-ed5842dd-d245-4848-b610-e9fa15896adf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:44.079735 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-ed5842dd-d245-4848-b610-e9fa15896adf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:44.109111 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ed5842dd-d245-4848-b610-e9fa15896adf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:44.117679 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-6f632094-7060-4163-9d5f-1ef2b59c02fe tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Flavor limits 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:40:44.118319 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-6f632094-7060-4163-9d5f-1ef2b59c02fe tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Image limits 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:40:44.118600 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-6f632094-7060-4163-9d5f-1ef2b59c02fe tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Flavor pref 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:40:44.118968 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ed5842dd-d245-4848-b610-e9fa15896adf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:44.119795 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-6f632094-7060-4163-9d5f-1ef2b59c02fe tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Image pref 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:40:44.120723 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ed5842dd-d245-4848-b610-e9fa15896adf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:44.120975 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-6f632094-7060-4163-9d5f-1ef2b59c02fe tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:40:44.123755 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ed5842dd-d245-4848-b610-e9fa15896adf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:44.124749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ed5842dd-d245-4848-b610-e9fa15896adf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:44.125814 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ed5842dd-d245-4848-b610-e9fa15896adf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:44.157759 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6f632094-7060-4163-9d5f-1ef2b59c02fe tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:44.158564 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6f632094-7060-4163-9d5f-1ef2b59c02fe tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:44.159175 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6f632094-7060-4163-9d5f-1ef2b59c02fe tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:44.160117 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6f632094-7060-4163-9d5f-1ef2b59c02fe tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:44.160870 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6f632094-7060-4163-9d5f-1ef2b59c02fe tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:44.161557 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6f632094-7060-4163-9d5f-1ef2b59c02fe tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:44.211306 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-6f632094-7060-4163-9d5f-1ef2b59c02fe tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Getting quotas for project 1804d01585764cf7bb02bd332a66573e. Resources: {'instances', 'cores', 'ram'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:40:44.224637 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-6f632094-7060-4163-9d5f-1ef2b59c02fe tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Getting quotas for user 16d0510b86c6444480ef4447a8a0a997 and project 1804d01585764cf7bb02bd332a66573e. Resources: {'instances', 'cores', 'ram'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:40:44.256650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-6f632094-7060-4163-9d5f-1ef2b59c02fe tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Going to run 1 instances... {{(pid=133014) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 13:40:44.261856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-6f632094-7060-4163-9d5f-1ef2b59c02fe tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c520113c-3dae-4490-98bb-19fe3a46b66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133014) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 13:40:44.326508 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:40:44.410055 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-ed5842dd-d245-4848-b610-e9fa15896adf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:44.422888 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-ed5842dd-d245-4848-b610-e9fa15896adf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.359703 Aug 24 13:40:44.424154 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 131/262] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:44 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:44.429561 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-2400fcfd-16f8-4d22-90c2-d8df71178789 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:44.430652 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-2400fcfd-16f8-4d22-90c2-d8df71178789 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:44.437297 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2400fcfd-16f8-4d22-90c2-d8df71178789 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:44.438014 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2400fcfd-16f8-4d22-90c2-d8df71178789 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:44.441371 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2400fcfd-16f8-4d22-90c2-d8df71178789 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:44.441371 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2400fcfd-16f8-4d22-90c2-d8df71178789 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:44.441371 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2400fcfd-16f8-4d22-90c2-d8df71178789 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:44.441371 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2400fcfd-16f8-4d22-90c2-d8df71178789 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:44.532161 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-6f632094-7060-4163-9d5f-1ef2b59c02fe tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.021730 Aug 24 13:40:44.544313 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 132/263] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 13:40:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 13:40:44.569934 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-5caedc15-4d52-4794-934e-76248ec8f497 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:44.593321 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-5caedc15-4d52-4794-934e-76248ec8f497 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:44.641749 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5caedc15-4d52-4794-934e-76248ec8f497 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:44.645023 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5caedc15-4d52-4794-934e-76248ec8f497 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:44.646416 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5caedc15-4d52-4794-934e-76248ec8f497 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:44.649679 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5caedc15-4d52-4794-934e-76248ec8f497 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:44.655962 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5caedc15-4d52-4794-934e-76248ec8f497 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:44.656585 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5caedc15-4d52-4794-934e-76248ec8f497 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:44.713784 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2400fcfd-16f8-4d22-90c2-d8df71178789 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:44.726485 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-2400fcfd-16f8-4d22-90c2-d8df71178789 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 200 len: 1496 microversion: 2.1 time: 0.295133 Aug 24 13:40:44.727781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 132/264] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:44 2022] GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 1496 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:44.733732 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-89cccd8b-07b8-4be2-a568-bd30001913f8 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:44.735777 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-89cccd8b-07b8-4be2-a568-bd30001913f8 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:44.901531 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-89cccd8b-07b8-4be2-a568-bd30001913f8 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d0510b86c6444480ef4447a8a0a997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1804d01585764cf7bb02bd332a66573e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:44.946101 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-89cccd8b-07b8-4be2-a568-bd30001913f8 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240" status: 200 len: 1215 microversion: 2.1 time: 0.209278 Aug 24 13:40:44.947162 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 133/265] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:44 2022] GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 => generated 1215 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:45.078783 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-c8a476a2-5b57-43a3-936b-24486d2a4fa7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:45.080373 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-c8a476a2-5b57-43a3-936b-24486d2a4fa7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:45.105110 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c8a476a2-5b57-43a3-936b-24486d2a4fa7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:45.105665 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c8a476a2-5b57-43a3-936b-24486d2a4fa7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:45.106104 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c8a476a2-5b57-43a3-936b-24486d2a4fa7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:45.107054 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c8a476a2-5b57-43a3-936b-24486d2a4fa7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:45.107421 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c8a476a2-5b57-43a3-936b-24486d2a4fa7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:45.114310 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c8a476a2-5b57-43a3-936b-24486d2a4fa7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:45.183458 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-5caedc15-4d52-4794-934e-76248ec8f497 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:45.250098 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-5caedc15-4d52-4794-934e-76248ec8f497 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6" status: 200 len: 1367 microversion: 2.1 time: 0.703567 Aug 24 13:40:45.258374 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 133/266] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:44 2022] GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 => generated 1367 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:45.415996 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c8a476a2-5b57-43a3-936b-24486d2a4fa7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:45.447182 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-b317cc32-9e44-4da2-8ae1-67da99bb7abf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:45.450068 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-b317cc32-9e44-4da2-8ae1-67da99bb7abf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:45.471053 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b317cc32-9e44-4da2-8ae1-67da99bb7abf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:45.471585 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b317cc32-9e44-4da2-8ae1-67da99bb7abf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:45.472026 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b317cc32-9e44-4da2-8ae1-67da99bb7abf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:45.472760 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b317cc32-9e44-4da2-8ae1-67da99bb7abf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:45.488809 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c8a476a2-5b57-43a3-936b-24486d2a4fa7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:45.491102 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c8a476a2-5b57-43a3-936b-24486d2a4fa7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:45.492416 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-c8a476a2-5b57-43a3-936b-24486d2a4fa7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1741 microversion: 2.20 time: 0.418450 Aug 24 13:40:45.496711 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b317cc32-9e44-4da2-8ae1-67da99bb7abf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:45.497167 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b317cc32-9e44-4da2-8ae1-67da99bb7abf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:45.503727 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 134/267] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:45 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1741 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:40:45.780672 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-b317cc32-9e44-4da2-8ae1-67da99bb7abf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:45.793333 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-b317cc32-9e44-4da2-8ae1-67da99bb7abf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.351333 Aug 24 13:40:45.794715 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 134/268] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:45 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:45.975545 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-36c09ae9-398a-438a-93ca-fcc099322eec tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:45.976295 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-36c09ae9-398a-438a-93ca-fcc099322eec tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:46.221602 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-36c09ae9-398a-438a-93ca-fcc099322eec tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d0510b86c6444480ef4447a8a0a997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1804d01585764cf7bb02bd332a66573e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:46.237423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-36c09ae9-398a-438a-93ca-fcc099322eec tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240" status: 200 len: 1215 microversion: 2.1 time: 0.266156 Aug 24 13:40:46.242574 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 135/269] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:45 2022] GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 => generated 1215 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:46.276304 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-4cd2fbb3-89f7-4247-88dd-8d64a4ee37cc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:46.277068 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-4cd2fbb3-89f7-4247-88dd-8d64a4ee37cc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:46.302539 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4cd2fbb3-89f7-4247-88dd-8d64a4ee37cc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:46.303348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4cd2fbb3-89f7-4247-88dd-8d64a4ee37cc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:46.303978 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4cd2fbb3-89f7-4247-88dd-8d64a4ee37cc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:46.311641 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4cd2fbb3-89f7-4247-88dd-8d64a4ee37cc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:46.316984 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4cd2fbb3-89f7-4247-88dd-8d64a4ee37cc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:46.317681 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4cd2fbb3-89f7-4247-88dd-8d64a4ee37cc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:46.433000 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-fb5649fb-571a-40a6-b396-79f5b5a99b0f tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:46.438909 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-fb5649fb-571a-40a6-b396-79f5b5a99b0f tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:46.457567 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fb5649fb-571a-40a6-b396-79f5b5a99b0f tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:46.459029 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fb5649fb-571a-40a6-b396-79f5b5a99b0f tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:46.460109 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fb5649fb-571a-40a6-b396-79f5b5a99b0f tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:46.462050 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fb5649fb-571a-40a6-b396-79f5b5a99b0f tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:46.463244 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fb5649fb-571a-40a6-b396-79f5b5a99b0f tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:46.464609 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fb5649fb-571a-40a6-b396-79f5b5a99b0f tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:46.544928 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-fb5649fb-571a-40a6-b396-79f5b5a99b0f tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Going to try to terminate instance {{(pid=133015) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 13:40:46.942140 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-4cd2fbb3-89f7-4247-88dd-8d64a4ee37cc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:46.968046 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-4cd2fbb3-89f7-4247-88dd-8d64a4ee37cc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6" status: 200 len: 1367 microversion: 2.1 time: 0.687230 Aug 24 13:40:46.983165 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 135/270] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:46 2022] GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 => generated 1367 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:47.024149 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a0f6de5d-084e-4ef5-a964-05d1e3afa32d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:47.029173 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a0f6de5d-084e-4ef5-a964-05d1e3afa32d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:47.054556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a0f6de5d-084e-4ef5-a964-05d1e3afa32d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:47.060604 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a0f6de5d-084e-4ef5-a964-05d1e3afa32d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:47.061332 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a0f6de5d-084e-4ef5-a964-05d1e3afa32d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:47.064854 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a0f6de5d-084e-4ef5-a964-05d1e3afa32d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:47.066302 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a0f6de5d-084e-4ef5-a964-05d1e3afa32d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:47.068114 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a0f6de5d-084e-4ef5-a964-05d1e3afa32d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:47.188142 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-fb5649fb-571a-40a6-b396-79f5b5a99b0f tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "DELETE /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 204 len: 0 microversion: 2.1 time: 0.763937 Aug 24 13:40:47.188799 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 136/271] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:40:46 2022] DELETE /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 0 bytes in 766 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:40:47.199672 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a617f502-4ee9-4c5e-bf91-50b8f868975e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:47.200476 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-a617f502-4ee9-4c5e-bf91-50b8f868975e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:47.214191 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a617f502-4ee9-4c5e-bf91-50b8f868975e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:47.215177 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a617f502-4ee9-4c5e-bf91-50b8f868975e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:47.227049 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a617f502-4ee9-4c5e-bf91-50b8f868975e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:47.228742 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a617f502-4ee9-4c5e-bf91-50b8f868975e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:47.229474 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a617f502-4ee9-4c5e-bf91-50b8f868975e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:47.230171 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a617f502-4ee9-4c5e-bf91-50b8f868975e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:47.362063 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a0f6de5d-084e-4ef5-a964-05d1e3afa32d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:47.385656 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a0f6de5d-084e-4ef5-a964-05d1e3afa32d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:47.392718 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a0f6de5d-084e-4ef5-a964-05d1e3afa32d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:47.398811 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a0f6de5d-084e-4ef5-a964-05d1e3afa32d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1741 microversion: 2.20 time: 0.409301 Aug 24 13:40:47.399013 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 136/272] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:46 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1741 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:47.410927 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-ef023041-7d04-430a-88a8-931858a84383 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:47.412560 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-ef023041-7d04-430a-88a8-931858a84383 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:47.433020 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ef023041-7d04-430a-88a8-931858a84383 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:47.436969 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ef023041-7d04-430a-88a8-931858a84383 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:47.442284 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ef023041-7d04-430a-88a8-931858a84383 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:47.444392 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ef023041-7d04-430a-88a8-931858a84383 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:47.445844 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ef023041-7d04-430a-88a8-931858a84383 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:47.448887 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ef023041-7d04-430a-88a8-931858a84383 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:47.838678 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-a617f502-4ee9-4c5e-bf91-50b8f868975e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:47.850789 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a617f502-4ee9-4c5e-bf91-50b8f868975e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.656243 Aug 24 13:40:47.851971 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 137/273] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:47 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:47.858920 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-42629830-e791-4403-b185-b47d77a185ff tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:47.860040 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-42629830-e791-4403-b185-b47d77a185ff tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:47.892828 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-42629830-e791-4403-b185-b47d77a185ff tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:47.893336 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-42629830-e791-4403-b185-b47d77a185ff tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:47.893773 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-42629830-e791-4403-b185-b47d77a185ff tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:47.894713 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-42629830-e791-4403-b185-b47d77a185ff tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:47.895182 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-42629830-e791-4403-b185-b47d77a185ff tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:47.895613 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-42629830-e791-4403-b185-b47d77a185ff tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:47.963015 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-ef023041-7d04-430a-88a8-931858a84383 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:48.003372 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-ef023041-7d04-430a-88a8-931858a84383 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 200 len: 1502 microversion: 2.1 time: 0.603038 Aug 24 13:40:48.019719 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 137/274] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:47 2022] GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 1502 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:48.037254 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-9e699873-87fd-40bc-8ba3-f5085bb914f1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:48.038181 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-9e699873-87fd-40bc-8ba3-f5085bb914f1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:48.046948 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9e699873-87fd-40bc-8ba3-f5085bb914f1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:48.047748 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9e699873-87fd-40bc-8ba3-f5085bb914f1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:48.048402 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9e699873-87fd-40bc-8ba3-f5085bb914f1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:48.049336 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9e699873-87fd-40bc-8ba3-f5085bb914f1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:48.049978 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9e699873-87fd-40bc-8ba3-f5085bb914f1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:48.050568 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9e699873-87fd-40bc-8ba3-f5085bb914f1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:48.077065 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-42629830-e791-4403-b185-b47d77a185ff tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d0510b86c6444480ef4447a8a0a997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1804d01585764cf7bb02bd332a66573e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:48.091929 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-42629830-e791-4403-b185-b47d77a185ff tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240" status: 200 len: 1211 microversion: 2.1 time: 0.236283 Aug 24 13:40:48.110350 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 138/275] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:47 2022] GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 => generated 1211 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:48.423456 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a7de0f11-81bb-4d02-ae17-e65cac5e8eec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:48.424565 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-a7de0f11-81bb-4d02-ae17-e65cac5e8eec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:48.443843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a7de0f11-81bb-4d02-ae17-e65cac5e8eec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:48.446217 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a7de0f11-81bb-4d02-ae17-e65cac5e8eec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:48.447947 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a7de0f11-81bb-4d02-ae17-e65cac5e8eec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:48.448933 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a7de0f11-81bb-4d02-ae17-e65cac5e8eec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:48.449652 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a7de0f11-81bb-4d02-ae17-e65cac5e8eec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:48.450378 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a7de0f11-81bb-4d02-ae17-e65cac5e8eec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:48.496927 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-9e699873-87fd-40bc-8ba3-f5085bb914f1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:48.509988 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-9e699873-87fd-40bc-8ba3-f5085bb914f1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6" status: 200 len: 1367 microversion: 2.1 time: 0.477803 Aug 24 13:40:48.512489 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 138/276] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:48 2022] GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 => generated 1367 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:40:48.678537 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-a7de0f11-81bb-4d02-ae17-e65cac5e8eec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:48.698951 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-a7de0f11-81bb-4d02-ae17-e65cac5e8eec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:48.702672 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-a7de0f11-81bb-4d02-ae17-e65cac5e8eec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:48.704381 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a7de0f11-81bb-4d02-ae17-e65cac5e8eec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1741 microversion: 2.20 time: 0.285997 Aug 24 13:40:48.705529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 139/277] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:48 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1741 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:48.882970 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-d85299a0-87ae-45e1-924c-ad45a5e7e507 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:48.883689 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-d85299a0-87ae-45e1-924c-ad45a5e7e507 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:48.892577 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d85299a0-87ae-45e1-924c-ad45a5e7e507 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:48.893413 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d85299a0-87ae-45e1-924c-ad45a5e7e507 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:48.894164 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d85299a0-87ae-45e1-924c-ad45a5e7e507 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:48.894925 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d85299a0-87ae-45e1-924c-ad45a5e7e507 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:48.895394 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d85299a0-87ae-45e1-924c-ad45a5e7e507 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:48.895819 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d85299a0-87ae-45e1-924c-ad45a5e7e507 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:49.033194 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-0bb8ab40-a50c-4067-a0a9-868ae30abb56 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:49.033828 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-0bb8ab40-a50c-4067-a0a9-868ae30abb56 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:49.052272 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0bb8ab40-a50c-4067-a0a9-868ae30abb56 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:49.063301 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0bb8ab40-a50c-4067-a0a9-868ae30abb56 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:49.063854 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0bb8ab40-a50c-4067-a0a9-868ae30abb56 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:49.064680 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0bb8ab40-a50c-4067-a0a9-868ae30abb56 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:49.065171 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0bb8ab40-a50c-4067-a0a9-868ae30abb56 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:49.065610 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0bb8ab40-a50c-4067-a0a9-868ae30abb56 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:49.692372 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-0bb8ab40-a50c-4067-a0a9-868ae30abb56 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:49.713557 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-0bb8ab40-a50c-4067-a0a9-868ae30abb56 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 200 len: 1502 microversion: 2.1 time: 0.684909 Aug 24 13:40:49.718318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 140/278] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:49 2022] GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 1502 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:49.738015 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a47e6cda-b6a3-4f3a-bfd6-97b52a3da711 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:49.745158 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-a47e6cda-b6a3-4f3a-bfd6-97b52a3da711 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:49.767062 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a47e6cda-b6a3-4f3a-bfd6-97b52a3da711 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:49.768439 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a47e6cda-b6a3-4f3a-bfd6-97b52a3da711 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:49.774048 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a47e6cda-b6a3-4f3a-bfd6-97b52a3da711 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:49.774048 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a47e6cda-b6a3-4f3a-bfd6-97b52a3da711 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:49.774048 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a47e6cda-b6a3-4f3a-bfd6-97b52a3da711 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:49.774048 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a47e6cda-b6a3-4f3a-bfd6-97b52a3da711 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:49.819298 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-d85299a0-87ae-45e1-924c-ad45a5e7e507 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:49.877292 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-d85299a0-87ae-45e1-924c-ad45a5e7e507 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.997123 Aug 24 13:40:49.888657 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 139/279] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:48 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:49.909085 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-b85a3bb2-3ec6-4782-ae35-63b4313b4087 req-5bb76267-82e8-431f-a37a-ffd05e72e158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807615f2-1905-4a84-8a8b-574886415dc6", "name": "network-vif-plugged", "status": "completed", "tag": "6904bc03-dddb-4f6f-a036-c88fbbe8434e"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:40:49.934632 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-b85a3bb2-3ec6-4782-ae35-63b4313b4087 req-5bb76267-82e8-431f-a37a-ffd05e72e158 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:49.935754 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-b85a3bb2-3ec6-4782-ae35-63b4313b4087 req-5bb76267-82e8-431f-a37a-ffd05e72e158 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:49.936656 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-b85a3bb2-3ec6-4782-ae35-63b4313b4087 req-5bb76267-82e8-431f-a37a-ffd05e72e158 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:50.007553 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-b85a3bb2-3ec6-4782-ae35-63b4313b4087 req-5bb76267-82e8-431f-a37a-ffd05e72e158 service nova] Creating event network-vif-plugged:6904bc03-dddb-4f6f-a036-c88fbbe8434e for instance 807615f2-1905-4a84-8a8b-574886415dc6 on hv-cinder-77957 Aug 24 13:40:50.026922 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-b85a3bb2-3ec6-4782-ae35-63b4313b4087 req-5bb76267-82e8-431f-a37a-ffd05e72e158 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138637 Aug 24 13:40:50.035773 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 140/280] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:40:50.049186 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-c03e6ef3-fbf3-4573-8efb-55ac430561e6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:50.049919 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-c03e6ef3-fbf3-4573-8efb-55ac430561e6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:50.052738 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-a47e6cda-b6a3-4f3a-bfd6-97b52a3da711 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d0510b86c6444480ef4447a8a0a997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1804d01585764cf7bb02bd332a66573e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:50.063367 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a47e6cda-b6a3-4f3a-bfd6-97b52a3da711 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240" status: 200 len: 1267 microversion: 2.1 time: 0.343375 Aug 24 13:40:50.066396 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 141/281] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:49 2022] GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 => generated 1267 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:50.067229 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c03e6ef3-fbf3-4573-8efb-55ac430561e6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:50.067921 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c03e6ef3-fbf3-4573-8efb-55ac430561e6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:50.068407 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c03e6ef3-fbf3-4573-8efb-55ac430561e6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:50.069122 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c03e6ef3-fbf3-4573-8efb-55ac430561e6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:50.069576 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c03e6ef3-fbf3-4573-8efb-55ac430561e6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:50.070126 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c03e6ef3-fbf3-4573-8efb-55ac430561e6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:50.073789 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-67f26ff0-23c6-4714-8cf5-67b9e4ed9b01 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:50.074743 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-67f26ff0-23c6-4714-8cf5-67b9e4ed9b01 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:50.115760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-67f26ff0-23c6-4714-8cf5-67b9e4ed9b01 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:50.116421 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-67f26ff0-23c6-4714-8cf5-67b9e4ed9b01 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:50.116940 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-67f26ff0-23c6-4714-8cf5-67b9e4ed9b01 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:50.117809 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-67f26ff0-23c6-4714-8cf5-67b9e4ed9b01 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:50.118348 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-67f26ff0-23c6-4714-8cf5-67b9e4ed9b01 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:50.118852 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-67f26ff0-23c6-4714-8cf5-67b9e4ed9b01 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:50.178318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:40:50.512968 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-67f26ff0-23c6-4714-8cf5-67b9e4ed9b01 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:50.530486 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-67f26ff0-23c6-4714-8cf5-67b9e4ed9b01 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:50.533595 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-67f26ff0-23c6-4714-8cf5-67b9e4ed9b01 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:50.535483 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-67f26ff0-23c6-4714-8cf5-67b9e4ed9b01 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1741 microversion: 2.20 time: 0.467421 Aug 24 13:40:50.541659 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-c03e6ef3-fbf3-4573-8efb-55ac430561e6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:50.552333 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-c03e6ef3-fbf3-4573-8efb-55ac430561e6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6" status: 200 len: 1367 microversion: 2.1 time: 0.521890 Aug 24 13:40:50.552953 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 142/282] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:50 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1741 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:50.556608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 141/283] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:50 2022] GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 => generated 1367 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:50.745673 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-5d10ec54-9255-42fc-8774-433e845ccdb0 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:50.747863 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-5d10ec54-9255-42fc-8774-433e845ccdb0 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:50.787549 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5d10ec54-9255-42fc-8774-433e845ccdb0 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:50.788623 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5d10ec54-9255-42fc-8774-433e845ccdb0 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:50.789772 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5d10ec54-9255-42fc-8774-433e845ccdb0 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:50.792304 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5d10ec54-9255-42fc-8774-433e845ccdb0 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:50.799406 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5d10ec54-9255-42fc-8774-433e845ccdb0 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:50.803271 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5d10ec54-9255-42fc-8774-433e845ccdb0 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:50.910462 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-90659e46-f612-4feb-9a60-1978dc5b6efa tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:50.911851 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-90659e46-f612-4feb-9a60-1978dc5b6efa tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:50.940724 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-90659e46-f612-4feb-9a60-1978dc5b6efa tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:50.943456 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-90659e46-f612-4feb-9a60-1978dc5b6efa tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:50.945343 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-90659e46-f612-4feb-9a60-1978dc5b6efa tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:50.950317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-90659e46-f612-4feb-9a60-1978dc5b6efa tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:50.954273 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-90659e46-f612-4feb-9a60-1978dc5b6efa tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:50.955167 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-90659e46-f612-4feb-9a60-1978dc5b6efa tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:51.025852 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-5d10ec54-9255-42fc-8774-433e845ccdb0 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:51.036164 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-5d10ec54-9255-42fc-8774-433e845ccdb0 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 200 len: 1460 microversion: 2.1 time: 0.297937 Aug 24 13:40:51.043255 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 143/284] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:50 2022] GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 1460 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:51.087733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b892e0af-c55b-411d-af59-32e4191928c7 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:51.088399 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b892e0af-c55b-411d-af59-32e4191928c7 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:51.096772 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b892e0af-c55b-411d-af59-32e4191928c7 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:51.098146 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b892e0af-c55b-411d-af59-32e4191928c7 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:51.098781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b892e0af-c55b-411d-af59-32e4191928c7 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:51.099668 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b892e0af-c55b-411d-af59-32e4191928c7 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:51.100335 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b892e0af-c55b-411d-af59-32e4191928c7 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:51.100920 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b892e0af-c55b-411d-af59-32e4191928c7 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:51.232580 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b892e0af-c55b-411d-af59-32e4191928c7 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d0510b86c6444480ef4447a8a0a997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1804d01585764cf7bb02bd332a66573e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:51.245525 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b892e0af-c55b-411d-af59-32e4191928c7 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240" status: 200 len: 1285 microversion: 2.1 time: 0.164786 Aug 24 13:40:51.246972 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 144/285] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:51 2022] GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 => generated 1285 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:40:51.446123 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-90659e46-f612-4feb-9a60-1978dc5b6efa tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:51.462044 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-90659e46-f612-4feb-9a60-1978dc5b6efa tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.553551 Aug 24 13:40:51.462784 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 142/286] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:50 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:40:51.486438 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-81289532-39b7-41c5-a45f-aed339321643 req-8e6665a9-5eb3-4a67-a43c-5c31b82ba406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ffe8c1-ef80-42b6-aa3c-6f60ceea267b", "name": "network-vif-deleted", "tag": "217d6ecd-1ec6-4895-adb9-790e971bf720"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:40:51.505820 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-81289532-39b7-41c5-a45f-aed339321643 req-8e6665a9-5eb3-4a67-a43c-5c31b82ba406 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:51.506671 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-81289532-39b7-41c5-a45f-aed339321643 req-8e6665a9-5eb3-4a67-a43c-5c31b82ba406 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:51.507317 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-81289532-39b7-41c5-a45f-aed339321643 req-8e6665a9-5eb3-4a67-a43c-5c31b82ba406 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:51.521517 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-81289532-39b7-41c5-a45f-aed339321643 req-8e6665a9-5eb3-4a67-a43c-5c31b82ba406 service nova] Creating event network-vif-deleted:217d6ecd-1ec6-4895-adb9-790e971bf720 for instance 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b on hv-cinder-77957 Aug 24 13:40:51.527646 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-81289532-39b7-41c5-a45f-aed339321643 req-8e6665a9-5eb3-4a67-a43c-5c31b82ba406 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046237 Aug 24 13:40:51.529291 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 145/287] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:40:51.579246 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a45fdfae-120e-4beb-a129-a52024d2066b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:51.579924 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a45fdfae-120e-4beb-a129-a52024d2066b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:51.582582 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d4a785a8-5cd2-415d-b817-ffe378941926 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:51.583925 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-d4a785a8-5cd2-415d-b817-ffe378941926 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:51.586735 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a45fdfae-120e-4beb-a129-a52024d2066b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:51.587535 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a45fdfae-120e-4beb-a129-a52024d2066b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:51.587980 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a45fdfae-120e-4beb-a129-a52024d2066b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:51.588976 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a45fdfae-120e-4beb-a129-a52024d2066b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:51.589646 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a45fdfae-120e-4beb-a129-a52024d2066b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:51.590286 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a45fdfae-120e-4beb-a129-a52024d2066b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:51.592846 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d4a785a8-5cd2-415d-b817-ffe378941926 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:51.593387 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d4a785a8-5cd2-415d-b817-ffe378941926 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:51.594315 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d4a785a8-5cd2-415d-b817-ffe378941926 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:51.595235 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d4a785a8-5cd2-415d-b817-ffe378941926 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:51.597822 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d4a785a8-5cd2-415d-b817-ffe378941926 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:51.598638 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d4a785a8-5cd2-415d-b817-ffe378941926 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:52.076029 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d4a785a8-5cd2-415d-b817-ffe378941926 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:52.079338 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a45fdfae-120e-4beb-a129-a52024d2066b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:52.093268 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-d4a785a8-5cd2-415d-b817-ffe378941926 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6" status: 200 len: 1367 microversion: 2.1 time: 0.516678 Aug 24 13:40:52.094187 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 146/288] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:51 2022] GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 => generated 1367 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:40:52.095155 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a45fdfae-120e-4beb-a129-a52024d2066b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:52.097211 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a45fdfae-120e-4beb-a129-a52024d2066b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:52.098856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a45fdfae-120e-4beb-a129-a52024d2066b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1741 microversion: 2.20 time: 0.524164 Aug 24 13:40:52.099003 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-834a323c-e428-44f0-b9dc-9d65db505f47 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:52.099583 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-834a323c-e428-44f0-b9dc-9d65db505f47 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:52.100410 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 143/289] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:51 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1741 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:52.128811 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-834a323c-e428-44f0-b9dc-9d65db505f47 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:52.130564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-834a323c-e428-44f0-b9dc-9d65db505f47 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:52.131580 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-834a323c-e428-44f0-b9dc-9d65db505f47 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:52.132727 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-834a323c-e428-44f0-b9dc-9d65db505f47 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:52.133500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-834a323c-e428-44f0-b9dc-9d65db505f47 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:52.134133 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-834a323c-e428-44f0-b9dc-9d65db505f47 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:52.257868 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-834a323c-e428-44f0-b9dc-9d65db505f47 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:52.269399 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-834a323c-e428-44f0-b9dc-9d65db505f47 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 200 len: 1298 microversion: 2.1 time: 0.174069 Aug 24 13:40:52.272326 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-7abe8ece-deb4-4743-b3e2-21367c8d21e5 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:52.273380 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-7abe8ece-deb4-4743-b3e2-21367c8d21e5 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:52.285699 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 147/290] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:52 2022] GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 1298 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:52.302068 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7abe8ece-deb4-4743-b3e2-21367c8d21e5 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:52.302068 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7abe8ece-deb4-4743-b3e2-21367c8d21e5 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:52.302068 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7abe8ece-deb4-4743-b3e2-21367c8d21e5 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:52.302370 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7abe8ece-deb4-4743-b3e2-21367c8d21e5 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:52.303089 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7abe8ece-deb4-4743-b3e2-21367c8d21e5 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:52.303774 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7abe8ece-deb4-4743-b3e2-21367c8d21e5 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:52.458573 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-7abe8ece-deb4-4743-b3e2-21367c8d21e5 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d0510b86c6444480ef4447a8a0a997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1804d01585764cf7bb02bd332a66573e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:52.472294 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-7abe8ece-deb4-4743-b3e2-21367c8d21e5 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240" status: 200 len: 1273 microversion: 2.1 time: 0.201893 Aug 24 13:40:52.476504 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 144/291] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:52 2022] GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 => generated 1273 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:52.497170 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b2af1db5-39ba-4963-962e-36b7d559df4e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:52.501684 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b2af1db5-39ba-4963-962e-36b7d559df4e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:52.513503 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b2af1db5-39ba-4963-962e-36b7d559df4e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:52.516711 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b2af1db5-39ba-4963-962e-36b7d559df4e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:52.520640 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b2af1db5-39ba-4963-962e-36b7d559df4e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:52.521775 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b2af1db5-39ba-4963-962e-36b7d559df4e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:52.522252 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b2af1db5-39ba-4963-962e-36b7d559df4e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:52.522698 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b2af1db5-39ba-4963-962e-36b7d559df4e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:52.934991 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b2af1db5-39ba-4963-962e-36b7d559df4e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:52.956349 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b2af1db5-39ba-4963-962e-36b7d559df4e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.471223 Aug 24 13:40:52.961936 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 148/292] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:52 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:53.118069 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-5d31de38-4830-4be5-bf5d-ff9c98f72b72 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:53.118683 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-5d31de38-4830-4be5-bf5d-ff9c98f72b72 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:53.134299 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-acd67f3e-c566-43dd-9cd8-4512c31e8d6b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:53.134935 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-acd67f3e-c566-43dd-9cd8-4512c31e8d6b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:53.152077 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-acd67f3e-c566-43dd-9cd8-4512c31e8d6b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:53.152618 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-acd67f3e-c566-43dd-9cd8-4512c31e8d6b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:53.153061 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-acd67f3e-c566-43dd-9cd8-4512c31e8d6b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:53.153819 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-acd67f3e-c566-43dd-9cd8-4512c31e8d6b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:53.154535 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-acd67f3e-c566-43dd-9cd8-4512c31e8d6b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:53.155023 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-acd67f3e-c566-43dd-9cd8-4512c31e8d6b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:53.155256 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5d31de38-4830-4be5-bf5d-ff9c98f72b72 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:53.156415 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5d31de38-4830-4be5-bf5d-ff9c98f72b72 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:53.157348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5d31de38-4830-4be5-bf5d-ff9c98f72b72 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:53.159375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5d31de38-4830-4be5-bf5d-ff9c98f72b72 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:53.164137 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5d31de38-4830-4be5-bf5d-ff9c98f72b72 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:53.169928 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5d31de38-4830-4be5-bf5d-ff9c98f72b72 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:53.193551 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=100 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:40:53.674068 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-acd67f3e-c566-43dd-9cd8-4512c31e8d6b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:53.687935 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-5d31de38-4830-4be5-bf5d-ff9c98f72b72 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:53.701619 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-acd67f3e-c566-43dd-9cd8-4512c31e8d6b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:53.705336 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-acd67f3e-c566-43dd-9cd8-4512c31e8d6b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:53.707025 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-5d31de38-4830-4be5-bf5d-ff9c98f72b72 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6" status: 200 len: 1558 microversion: 2.1 time: 0.594986 Aug 24 13:40:53.723472 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-acd67f3e-c566-43dd-9cd8-4512c31e8d6b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1741 microversion: 2.20 time: 0.575889 Aug 24 13:40:53.725423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 149/293] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:53 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1741 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:53.732373 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 145/294] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:53 2022] GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 => generated 1558 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:53.737628 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-53bc6726-cda6-4065-a6ce-04b4629f2283 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:53.740468 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-34ef5921-0410-449f-ae4d-f0cbfea3c0e8 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:53.743797 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-34ef5921-0410-449f-ae4d-f0cbfea3c0e8 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:53.745523 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-53bc6726-cda6-4065-a6ce-04b4629f2283 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:53.760542 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-53bc6726-cda6-4065-a6ce-04b4629f2283 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:53.761333 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-53bc6726-cda6-4065-a6ce-04b4629f2283 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:53.762002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-53bc6726-cda6-4065-a6ce-04b4629f2283 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:53.763230 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-53bc6726-cda6-4065-a6ce-04b4629f2283 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:53.774298 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-34ef5921-0410-449f-ae4d-f0cbfea3c0e8 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:53.774298 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-34ef5921-0410-449f-ae4d-f0cbfea3c0e8 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:53.774298 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-34ef5921-0410-449f-ae4d-f0cbfea3c0e8 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:53.774614 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-53bc6726-cda6-4065-a6ce-04b4629f2283 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:53.774614 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-53bc6726-cda6-4065-a6ce-04b4629f2283 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:53.774753 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-34ef5921-0410-449f-ae4d-f0cbfea3c0e8 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:53.774753 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-34ef5921-0410-449f-ae4d-f0cbfea3c0e8 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:53.774753 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-34ef5921-0410-449f-ae4d-f0cbfea3c0e8 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:53.871930 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-34ef5921-0410-449f-ae4d-f0cbfea3c0e8 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:53.875676 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-34ef5921-0410-449f-ae4d-f0cbfea3c0e8 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:53.877693 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-34ef5921-0410-449f-ae4d-f0cbfea3c0e8 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:53.878369 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.objects.instance [None req-34ef5921-0410-449f-ae4d-f0cbfea3c0e8 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lazy-loading 'fault' on Instance uuid 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b {{(pid=133015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:40:53.901399 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-53bc6726-cda6-4065-a6ce-04b4629f2283 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d0510b86c6444480ef4447a8a0a997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1804d01585764cf7bb02bd332a66573e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:53.962112 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-53bc6726-cda6-4065-a6ce-04b4629f2283 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240" status: 200 len: 1273 microversion: 2.1 time: 0.228072 Aug 24 13:40:53.962710 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 146/295] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:53 2022] GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 => generated 1273 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:53.975156 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-416c76c4-325e-4247-a0d5-b3749e4af17b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:53.979561 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-416c76c4-325e-4247-a0d5-b3749e4af17b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:53.988247 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-34ef5921-0410-449f-ae4d-f0cbfea3c0e8 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c7ecfdb9904095b122bb8fd82121fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22fb394e99345d88b2e082b22902af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:53.991294 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-416c76c4-325e-4247-a0d5-b3749e4af17b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:53.992412 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-416c76c4-325e-4247-a0d5-b3749e4af17b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:53.993160 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-416c76c4-325e-4247-a0d5-b3749e4af17b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:53.995308 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-416c76c4-325e-4247-a0d5-b3749e4af17b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:54.010066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-416c76c4-325e-4247-a0d5-b3749e4af17b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:54.011402 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-416c76c4-325e-4247-a0d5-b3749e4af17b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:54.016031 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-34ef5921-0410-449f-ae4d-f0cbfea3c0e8 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 200 len: 1303 microversion: 2.1 time: 0.288819 Aug 24 13:40:54.020598 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 150/296] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:53 2022] GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 1303 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:54.026390 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-c56a7bbd-bce1-49c1-9164-bd2a9854df2d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:54.028050 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-c56a7bbd-bce1-49c1-9164-bd2a9854df2d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:54.056689 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c56a7bbd-bce1-49c1-9164-bd2a9854df2d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:54.064363 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c56a7bbd-bce1-49c1-9164-bd2a9854df2d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:54.064363 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c56a7bbd-bce1-49c1-9164-bd2a9854df2d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:54.064785 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c56a7bbd-bce1-49c1-9164-bd2a9854df2d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:54.066524 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c56a7bbd-bce1-49c1-9164-bd2a9854df2d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:54.067197 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c56a7bbd-bce1-49c1-9164-bd2a9854df2d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:54.188268 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=2 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:40:54.218336 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-416c76c4-325e-4247-a0d5-b3749e4af17b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.250871 Aug 24 13:40:54.223665 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 147/297] 10.222.0.73 () {58 vars in 1275 bytes} [Wed Aug 24 13:40:53 2022] GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6/os-interface => generated 285 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:40:54.512966 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c56a7bbd-bce1-49c1-9164-bd2a9854df2d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:54.530247 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-c56a7bbd-bce1-49c1-9164-bd2a9854df2d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.506506 Aug 24 13:40:54.531815 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 151/298] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:54 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:54.756448 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=6 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:40:54.761017 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a40f44a0-f42c-4ab5-ad37-f9ed854b364e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:54.761675 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a40f44a0-f42c-4ab5-ad37-f9ed854b364e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:54.782716 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a40f44a0-f42c-4ab5-ad37-f9ed854b364e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:54.783225 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a40f44a0-f42c-4ab5-ad37-f9ed854b364e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:54.783676 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a40f44a0-f42c-4ab5-ad37-f9ed854b364e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:54.792887 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a40f44a0-f42c-4ab5-ad37-f9ed854b364e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:54.793408 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a40f44a0-f42c-4ab5-ad37-f9ed854b364e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:54.793892 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a40f44a0-f42c-4ab5-ad37-f9ed854b364e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:54.987617 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-23355b49-44c1-4cf0-b3d4-bd9db74dbc64 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:54.988789 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-23355b49-44c1-4cf0-b3d4-bd9db74dbc64 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:55.009738 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-23355b49-44c1-4cf0-b3d4-bd9db74dbc64 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:55.010509 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-23355b49-44c1-4cf0-b3d4-bd9db74dbc64 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:55.011118 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-23355b49-44c1-4cf0-b3d4-bd9db74dbc64 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:55.012211 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-23355b49-44c1-4cf0-b3d4-bd9db74dbc64 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:55.012914 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-23355b49-44c1-4cf0-b3d4-bd9db74dbc64 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:55.017306 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-23355b49-44c1-4cf0-b3d4-bd9db74dbc64 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:55.778659 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-23355b49-44c1-4cf0-b3d4-bd9db74dbc64 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d0510b86c6444480ef4447a8a0a997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1804d01585764cf7bb02bd332a66573e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:55.790989 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-23355b49-44c1-4cf0-b3d4-bd9db74dbc64 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240" status: 200 len: 1315 microversion: 2.1 time: 0.810831 Aug 24 13:40:55.797628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 152/299] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:54 2022] GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 => generated 1315 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:55.807346 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a18ccbb5-fb5c-4299-8a81-b35d341e1808 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:55.808404 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-a18ccbb5-fb5c-4299-8a81-b35d341e1808 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] [instance: 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:55.817613 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a18ccbb5-fb5c-4299-8a81-b35d341e1808 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:55.818115 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a18ccbb5-fb5c-4299-8a81-b35d341e1808 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:55.818557 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a18ccbb5-fb5c-4299-8a81-b35d341e1808 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:55.819268 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a18ccbb5-fb5c-4299-8a81-b35d341e1808 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:55.819723 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a18ccbb5-fb5c-4299-8a81-b35d341e1808 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:55.820147 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a18ccbb5-fb5c-4299-8a81-b35d341e1808 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:55.843208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.wsgi [None req-a18ccbb5-fb5c-4299-8a81-b35d341e1808 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] HTTP exception thrown: Instance 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b could not be found. Aug 24 13:40:55.845314 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a18ccbb5-fb5c-4299-8a81-b35d341e1808 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Request method failure captured: Aug 24 13:40:55.845314 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b HTTP/1.1 Aug 24 13:40:55.845314 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:40:55.845314 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:40:55.845314 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:40:55.845314 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 0 Aug 24 13:40:55.845314 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:40:55.845314 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:40:55.845314 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:40:55.845314 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:40:55.845314 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBioiKeiczLI1cNZ2ea05cDeEtiFB7Q3jSOww1U99sv3nJN_aycwbturPOamMj48VZS5feqdG10INvjIBwQbGHwSRaJnnEA7me2Qigcz7VhNO5gsxBO_-0ru0cTCVUqun1RaQjSdsWTy5YEBya7TEMaLZt4Iz6RAFY6KPAugOAUwo7qA Aug 24 13:40:55.845314 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:40:55.845314 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:40:55.845314 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:40:55.845314 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:40:55.845314 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:40:55.845314 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:40:55.845314 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: c22fb394e99345d88b2e082b22902af3 Aug 24 13:40:55.845314 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-VolumesActionsTest-1917751200 Aug 24 13:40:55.845314 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:40:55.845314 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:40:55.847718 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c22fb394e99345d88b2e082b22902af3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c22fb394e99345d88b2e082b22902af3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c22fb394e99345d88b2e082b22902af3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c22fb394e99345d88b2e082b22902af3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:40:55.847718 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-VolumesActionsTest-1917751200 Aug 24 13:40:55.847718 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: c22fb394e99345d88b2e082b22902af3 Aug 24 13:40:55.847718 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-VolumesActionsTest-1917751200 Aug 24 13:40:55.847718 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-VolumesActionsTest-1917751200-project Aug 24 13:40:55.847718 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:40:55.847718 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:40:55.847718 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: e9c7ecfdb9904095b122bb8fd82121fe Aug 24 13:40:55.847718 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-VolumesActionsTest-1917751200-project Aug 24 13:40:55.847718 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: > Aug 24 13:40:55.847718 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Instance 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b could not be found. Aug 24 13:40:55.847718 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'id': '46ffe8c1-ef80-42b6-aa3c-6f60ceea267b'} Aug 24 13:40:55.848478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:40:55.848478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:40:55.848478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:40:55.848478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:40:55.848478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:40:55.848478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:40:55.848478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:40:55.848478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:40:55.848478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:40:55.848478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:40:55.848478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b could not be found. Aug 24 13:40:55.848478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:40:55.848478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:40:55.848478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:40:55.848478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:40:55.848478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:40:55.848478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:40:55.848478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:40:55.848478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:40:55.848478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:40:55.849749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:40:55.849749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:40:55.849749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:40:55.849749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:40:55.849749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:40:55.849749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:40:55.849749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:40:55.849749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b could not be found. Aug 24 13:40:55.849749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:40:55.849749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:40:55.849749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:40:55.849749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:40:55.849749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:40:55.849749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:40:55.849749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:40:55.849749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:40:55.849749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b could not be found. Aug 24 13:40:55.849749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:40:55.852518 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a18ccbb5-fb5c-4299-8a81-b35d341e1808 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] Returning 404 to user: Instance 46ffe8c1-ef80-42b6-aa3c-6f60ceea267b could not be found. {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:40:55.853781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a18ccbb5-fb5c-4299-8a81-b35d341e1808 tempest-VolumesActionsTest-1917751200 tempest-VolumesActionsTest-1917751200-project] 10.222.0.73 "GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b" status: 404 len: 111 microversion: 2.1 time: 0.054924 Aug 24 13:40:55.854922 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 153/300] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:55 2022] GET /compute/v2.1/servers/46ffe8c1-ef80-42b6-aa3c-6f60ceea267b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:40:55.867981 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-f2bfb643-114d-423a-86f7-ff00c8991cd0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:55.868280 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-f2bfb643-114d-423a-86f7-ff00c8991cd0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:55.880389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f2bfb643-114d-423a-86f7-ff00c8991cd0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:55.886883 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f2bfb643-114d-423a-86f7-ff00c8991cd0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:55.887343 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f2bfb643-114d-423a-86f7-ff00c8991cd0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:55.888419 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f2bfb643-114d-423a-86f7-ff00c8991cd0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:55.888909 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f2bfb643-114d-423a-86f7-ff00c8991cd0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:55.889324 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f2bfb643-114d-423a-86f7-ff00c8991cd0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:55.914996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a40f44a0-f42c-4ab5-ad37-f9ed854b364e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:55.927145 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a40f44a0-f42c-4ab5-ad37-f9ed854b364e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:55.932458 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a40f44a0-f42c-4ab5-ad37-f9ed854b364e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:55.933809 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a40f44a0-f42c-4ab5-ad37-f9ed854b364e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1741 microversion: 2.20 time: 1.178245 Aug 24 13:40:55.934791 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 148/301] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:54 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1741 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:56.101289 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f2bfb643-114d-423a-86f7-ff00c8991cd0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:56.112842 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-f2bfb643-114d-423a-86f7-ff00c8991cd0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.256229 Aug 24 13:40:56.113746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 154/302] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:55 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:56.822458 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-47c91244-ccb0-4385-863d-de5953c0019c tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:56.823548 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-47c91244-ccb0-4385-863d-de5953c0019c tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:56.856615 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-47c91244-ccb0-4385-863d-de5953c0019c tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:56.857665 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-47c91244-ccb0-4385-863d-de5953c0019c tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:56.870253 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-47c91244-ccb0-4385-863d-de5953c0019c tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:56.871360 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-47c91244-ccb0-4385-863d-de5953c0019c tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:56.887060 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-47c91244-ccb0-4385-863d-de5953c0019c tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:56.893996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-47c91244-ccb0-4385-863d-de5953c0019c tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:56.988266 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-7210b8c3-9f16-463a-9a0f-a0a50c04cf42 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:57.019478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-7210b8c3-9f16-463a-9a0f-a0a50c04cf42 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:57.032534 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=4 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:40:57.089946 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7210b8c3-9f16-463a-9a0f-a0a50c04cf42 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:57.090613 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7210b8c3-9f16-463a-9a0f-a0a50c04cf42 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:57.091399 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7210b8c3-9f16-463a-9a0f-a0a50c04cf42 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:57.092541 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7210b8c3-9f16-463a-9a0f-a0a50c04cf42 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:57.093161 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7210b8c3-9f16-463a-9a0f-a0a50c04cf42 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:57.093601 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7210b8c3-9f16-463a-9a0f-a0a50c04cf42 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:57.764787 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-47c91244-ccb0-4385-863d-de5953c0019c tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d0510b86c6444480ef4447a8a0a997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1804d01585764cf7bb02bd332a66573e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:57.777499 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-47c91244-ccb0-4385-863d-de5953c0019c tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240" status: 200 len: 1315 microversion: 2.1 time: 0.962166 Aug 24 13:40:57.782658 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 149/303] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:56 2022] GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 => generated 1315 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:40:57.789817 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-070dc360-a38e-4fb8-adb7-c7947df7d393 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:57.795934 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-070dc360-a38e-4fb8-adb7-c7947df7d393 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:57.811469 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-070dc360-a38e-4fb8-adb7-c7947df7d393 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:57.814174 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-070dc360-a38e-4fb8-adb7-c7947df7d393 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:57.814174 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-070dc360-a38e-4fb8-adb7-c7947df7d393 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:57.814589 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-070dc360-a38e-4fb8-adb7-c7947df7d393 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:57.815886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-070dc360-a38e-4fb8-adb7-c7947df7d393 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:57.817241 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-070dc360-a38e-4fb8-adb7-c7947df7d393 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:57.895367 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-7210b8c3-9f16-463a-9a0f-a0a50c04cf42 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:57.945874 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-7210b8c3-9f16-463a-9a0f-a0a50c04cf42 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:57.954831 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-7210b8c3-9f16-463a-9a0f-a0a50c04cf42 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:57.963712 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-7210b8c3-9f16-463a-9a0f-a0a50c04cf42 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1741 microversion: 2.20 time: 1.001282 Aug 24 13:40:57.963712 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 155/304] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:56 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1741 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:40:57.985667 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-1356756b-d6a2-4dbb-aef7-59606a48b212 req-9de26a38-d7f1-4afd-8f23-3afa7f9796ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfabd1a5-c2a2-414a-adc6-32693668f240", "tag": "0574bb60-a785-42a3-82cd-8678148d77ab"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:40:57.999940 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-1356756b-d6a2-4dbb-aef7-59606a48b212 req-9de26a38-d7f1-4afd-8f23-3afa7f9796ce service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:58.004149 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-1356756b-d6a2-4dbb-aef7-59606a48b212 req-9de26a38-d7f1-4afd-8f23-3afa7f9796ce service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:58.004881 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-1356756b-d6a2-4dbb-aef7-59606a48b212 req-9de26a38-d7f1-4afd-8f23-3afa7f9796ce service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:58.021087 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-1356756b-d6a2-4dbb-aef7-59606a48b212 req-9de26a38-d7f1-4afd-8f23-3afa7f9796ce service nova] Creating event network-changed:0574bb60-a785-42a3-82cd-8678148d77ab for instance dfabd1a5-c2a2-414a-adc6-32693668f240 on hv-cinder-77957 Aug 24 13:40:58.027367 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-1356756b-d6a2-4dbb-aef7-59606a48b212 req-9de26a38-d7f1-4afd-8f23-3afa7f9796ce service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047397 Aug 24 13:40:58.028780 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 156/305] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:40:58.120330 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-070dc360-a38e-4fb8-adb7-c7947df7d393 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:58.130429 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-070dc360-a38e-4fb8-adb7-c7947df7d393 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.346506 Aug 24 13:40:58.131049 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 150/306] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:57 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:58.300508 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-aa023f1b-3fbb-4143-9bff-eecddea65577 req-96f3e937-11b2-4d8d-829e-b4ba70babe95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807615f2-1905-4a84-8a8b-574886415dc6", "tag": "6904bc03-dddb-4f6f-a036-c88fbbe8434e"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:40:58.311877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-aa023f1b-3fbb-4143-9bff-eecddea65577 req-96f3e937-11b2-4d8d-829e-b4ba70babe95 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:58.312663 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-aa023f1b-3fbb-4143-9bff-eecddea65577 req-96f3e937-11b2-4d8d-829e-b4ba70babe95 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:58.313249 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-aa023f1b-3fbb-4143-9bff-eecddea65577 req-96f3e937-11b2-4d8d-829e-b4ba70babe95 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:58.328749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-aa023f1b-3fbb-4143-9bff-eecddea65577 req-96f3e937-11b2-4d8d-829e-b4ba70babe95 service nova] Creating event network-changed:6904bc03-dddb-4f6f-a036-c88fbbe8434e for instance 807615f2-1905-4a84-8a8b-574886415dc6 on hv-cinder-77957 Aug 24 13:40:58.336582 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-aa023f1b-3fbb-4143-9bff-eecddea65577 req-96f3e937-11b2-4d8d-829e-b4ba70babe95 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041142 Aug 24 13:40:58.342898 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 157/307] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:40:58.803581 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-74cff95c-73ff-4700-a229-0ce7371522b1 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:58.804242 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-74cff95c-73ff-4700-a229-0ce7371522b1 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:58.820997 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-74cff95c-73ff-4700-a229-0ce7371522b1 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:58.820997 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-74cff95c-73ff-4700-a229-0ce7371522b1 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:58.820997 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-74cff95c-73ff-4700-a229-0ce7371522b1 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:58.820997 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-74cff95c-73ff-4700-a229-0ce7371522b1 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:58.821515 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-74cff95c-73ff-4700-a229-0ce7371522b1 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:58.821515 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-74cff95c-73ff-4700-a229-0ce7371522b1 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:58.987546 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-e54b5acd-36d5-47fe-aae9-03358494694b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:58.988468 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-e54b5acd-36d5-47fe-aae9-03358494694b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:59.014351 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e54b5acd-36d5-47fe-aae9-03358494694b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:59.014351 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e54b5acd-36d5-47fe-aae9-03358494694b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:59.015132 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e54b5acd-36d5-47fe-aae9-03358494694b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:59.015630 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e54b5acd-36d5-47fe-aae9-03358494694b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:59.016240 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e54b5acd-36d5-47fe-aae9-03358494694b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:59.018400 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e54b5acd-36d5-47fe-aae9-03358494694b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:59.064539 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-74cff95c-73ff-4700-a229-0ce7371522b1 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d0510b86c6444480ef4447a8a0a997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1804d01585764cf7bb02bd332a66573e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:59.108880 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-74cff95c-73ff-4700-a229-0ce7371522b1 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240" status: 200 len: 1315 microversion: 2.1 time: 0.308691 Aug 24 13:40:59.111452 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 151/308] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:58 2022] GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:40:59.153931 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-cc9d6ce2-dfb6-4f6f-87e9-ea0f2b78a6c0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:40:59.155184 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-cc9d6ce2-dfb6-4f6f-87e9-ea0f2b78a6c0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:40:59.167205 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cc9d6ce2-dfb6-4f6f-87e9-ea0f2b78a6c0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:59.170611 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cc9d6ce2-dfb6-4f6f-87e9-ea0f2b78a6c0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:59.171782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cc9d6ce2-dfb6-4f6f-87e9-ea0f2b78a6c0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:59.174088 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cc9d6ce2-dfb6-4f6f-87e9-ea0f2b78a6c0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:40:59.174797 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cc9d6ce2-dfb6-4f6f-87e9-ea0f2b78a6c0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:40:59.176631 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cc9d6ce2-dfb6-4f6f-87e9-ea0f2b78a6c0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:40:59.585087 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-cc9d6ce2-dfb6-4f6f-87e9-ea0f2b78a6c0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:59.595650 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-e54b5acd-36d5-47fe-aae9-03358494694b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:59.600679 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-cc9d6ce2-dfb6-4f6f-87e9-ea0f2b78a6c0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.450363 Aug 24 13:40:59.603022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 152/309] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:40:59 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:40:59.611102 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-e54b5acd-36d5-47fe-aae9-03358494694b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:59.613267 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-e54b5acd-36d5-47fe-aae9-03358494694b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:40:59.614713 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-e54b5acd-36d5-47fe-aae9-03358494694b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1741 microversion: 2.20 time: 0.632542 Aug 24 13:40:59.616274 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 158/310] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:40:58 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1741 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:00.140511 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-29ce8557-eca5-4fdc-9312-3006a2c612aa tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:00.141956 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-29ce8557-eca5-4fdc-9312-3006a2c612aa tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:00.150859 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-29ce8557-eca5-4fdc-9312-3006a2c612aa tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:00.151555 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-29ce8557-eca5-4fdc-9312-3006a2c612aa tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:00.152231 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-29ce8557-eca5-4fdc-9312-3006a2c612aa tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:00.157407 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-29ce8557-eca5-4fdc-9312-3006a2c612aa tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:00.158180 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-29ce8557-eca5-4fdc-9312-3006a2c612aa tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:00.158786 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-29ce8557-eca5-4fdc-9312-3006a2c612aa tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:00.445034 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-29ce8557-eca5-4fdc-9312-3006a2c612aa tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d0510b86c6444480ef4447a8a0a997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1804d01585764cf7bb02bd332a66573e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:00.480340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-29ce8557-eca5-4fdc-9312-3006a2c612aa tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240" status: 200 len: 1315 microversion: 2.1 time: 0.342407 Aug 24 13:41:00.483502 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 153/311] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:00 2022] GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:41:00.627577 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b064fceb-556f-4cb1-aa51-1a92fbb94d34 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:00.629792 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b064fceb-556f-4cb1-aa51-1a92fbb94d34 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:00.647040 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b064fceb-556f-4cb1-aa51-1a92fbb94d34 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:00.647849 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b064fceb-556f-4cb1-aa51-1a92fbb94d34 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:00.648652 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b064fceb-556f-4cb1-aa51-1a92fbb94d34 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:00.653972 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b064fceb-556f-4cb1-aa51-1a92fbb94d34 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:00.653972 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b064fceb-556f-4cb1-aa51-1a92fbb94d34 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:00.653972 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b064fceb-556f-4cb1-aa51-1a92fbb94d34 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:00.654488 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e6b61815-e1b8-4b12-9ba4-12580006d7a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:00.655396 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-e6b61815-e1b8-4b12-9ba4-12580006d7a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:00.676681 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e6b61815-e1b8-4b12-9ba4-12580006d7a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:00.682324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e6b61815-e1b8-4b12-9ba4-12580006d7a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:00.682324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e6b61815-e1b8-4b12-9ba4-12580006d7a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:00.682324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e6b61815-e1b8-4b12-9ba4-12580006d7a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:00.682324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e6b61815-e1b8-4b12-9ba4-12580006d7a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:00.682706 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e6b61815-e1b8-4b12-9ba4-12580006d7a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:00.975849 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b064fceb-556f-4cb1-aa51-1a92fbb94d34 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:01.001662 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b064fceb-556f-4cb1-aa51-1a92fbb94d34 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.381459 Aug 24 13:41:01.002701 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 159/312] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:00 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:01.041981 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e6b61815-e1b8-4b12-9ba4-12580006d7a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:01.057929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e6b61815-e1b8-4b12-9ba4-12580006d7a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:01.068674 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e6b61815-e1b8-4b12-9ba4-12580006d7a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:01.070561 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-e6b61815-e1b8-4b12-9ba4-12580006d7a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1741 microversion: 2.20 time: 0.428872 Aug 24 13:41:01.070916 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 154/313] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:00 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1741 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:01.511989 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-c200898a-57d2-4c63-891c-8bec95f9a37a tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:01.512691 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-c200898a-57d2-4c63-891c-8bec95f9a37a tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:01.526808 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c200898a-57d2-4c63-891c-8bec95f9a37a tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:01.526808 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c200898a-57d2-4c63-891c-8bec95f9a37a tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:01.526808 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c200898a-57d2-4c63-891c-8bec95f9a37a tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:01.526808 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c200898a-57d2-4c63-891c-8bec95f9a37a tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:01.527709 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c200898a-57d2-4c63-891c-8bec95f9a37a tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:01.527709 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c200898a-57d2-4c63-891c-8bec95f9a37a tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:01.742137 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c200898a-57d2-4c63-891c-8bec95f9a37a tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d0510b86c6444480ef4447a8a0a997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1804d01585764cf7bb02bd332a66573e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:01.756680 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-c200898a-57d2-4c63-891c-8bec95f9a37a tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240" status: 200 len: 1315 microversion: 2.1 time: 0.252788 Aug 24 13:41:01.757418 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 160/314] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:01 2022] GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:02.031820 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-dcc1a46b-4a96-467e-9438-f3fdca1785e8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:02.032693 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-dcc1a46b-4a96-467e-9438-f3fdca1785e8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:02.039561 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dcc1a46b-4a96-467e-9438-f3fdca1785e8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:02.040049 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dcc1a46b-4a96-467e-9438-f3fdca1785e8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:02.040741 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dcc1a46b-4a96-467e-9438-f3fdca1785e8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:02.041478 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dcc1a46b-4a96-467e-9438-f3fdca1785e8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:02.041955 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dcc1a46b-4a96-467e-9438-f3fdca1785e8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:02.042378 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dcc1a46b-4a96-467e-9438-f3fdca1785e8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:02.106756 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-46dd811a-cff4-4738-b96a-237672912468 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:02.107701 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-46dd811a-cff4-4738-b96a-237672912468 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:02.118862 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-46dd811a-cff4-4738-b96a-237672912468 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:02.120302 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-46dd811a-cff4-4738-b96a-237672912468 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:02.124389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-46dd811a-cff4-4738-b96a-237672912468 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:02.124389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-46dd811a-cff4-4738-b96a-237672912468 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:02.125295 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-46dd811a-cff4-4738-b96a-237672912468 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:02.126409 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-46dd811a-cff4-4738-b96a-237672912468 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:02.182227 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=100 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:41:02.297974 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-dcc1a46b-4a96-467e-9438-f3fdca1785e8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:02.317652 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-dcc1a46b-4a96-467e-9438-f3fdca1785e8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.294132 Aug 24 13:41:02.330722 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 155/315] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:02 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:02.379443 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-46dd811a-cff4-4738-b96a-237672912468 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:02.393182 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-46dd811a-cff4-4738-b96a-237672912468 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:02.395163 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-46dd811a-cff4-4738-b96a-237672912468 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:02.396683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-46dd811a-cff4-4738-b96a-237672912468 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1741 microversion: 2.20 time: 0.302862 Aug 24 13:41:02.397266 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 161/316] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:02 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1741 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:02.796159 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b2b52f63-85e8-4512-a0f4-2490d6708b33 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:02.796877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b2b52f63-85e8-4512-a0f4-2490d6708b33 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:02.803930 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b2b52f63-85e8-4512-a0f4-2490d6708b33 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:02.804454 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b2b52f63-85e8-4512-a0f4-2490d6708b33 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:02.804895 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b2b52f63-85e8-4512-a0f4-2490d6708b33 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:02.805622 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b2b52f63-85e8-4512-a0f4-2490d6708b33 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:02.806088 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b2b52f63-85e8-4512-a0f4-2490d6708b33 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:02.806516 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b2b52f63-85e8-4512-a0f4-2490d6708b33 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:02.996412 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-71138ae8-e195-4f9a-9649-f7257e907e60 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Action: 'create', calling method: .version_select at 0x7f96c2b8bd30>, body: {"keypair": {"name": "tempest-TestShelveInstance-1608228831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqHwLcpWEoXrpoXoYGQyiyWHjhfDeA00Cs+DYqSsuF0atv+CzaN/l7nxhjDAg6Bm4or7iWBDUJWglDMBcTr+RRS4d7ximu2f0n6dtDx+jgVMtwgOrAzOlYRRxzu3g8giw=="}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:41:03.052732 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-71138ae8-e195-4f9a-9649-f7257e907e60 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Getting quotas for project 6bcafe839dec4fcc95a4c720463483ba. Resources: {'key_pairs'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:41:03.059123 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-71138ae8-e195-4f9a-9649-f7257e907e60 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Getting quotas for user 2730741d853a4cfcab1bbc990cf42611 and project 6bcafe839dec4fcc95a4c720463483ba. Resources: {'key_pairs'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:41:03.065365 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b2b52f63-85e8-4512-a0f4-2490d6708b33 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d0510b86c6444480ef4447a8a0a997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1804d01585764cf7bb02bd332a66573e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:03.081985 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b2b52f63-85e8-4512-a0f4-2490d6708b33 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240" status: 200 len: 1315 microversion: 2.1 time: 0.296839 Aug 24 13:41:03.082973 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 162/317] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:02 2022] GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:03.225426 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-71138ae8-e195-4f9a-9649-f7257e907e60 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.499050 Aug 24 13:41:03.232233 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 156/318] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 13:41:02 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:41:03.354908 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-fd4ed1c7-6585-4913-9319-160398a99ec2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:03.355616 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-fd4ed1c7-6585-4913-9319-160398a99ec2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:03.367602 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fd4ed1c7-6585-4913-9319-160398a99ec2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:03.368579 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fd4ed1c7-6585-4913-9319-160398a99ec2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:03.369550 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fd4ed1c7-6585-4913-9319-160398a99ec2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:03.371162 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fd4ed1c7-6585-4913-9319-160398a99ec2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:03.372737 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fd4ed1c7-6585-4913-9319-160398a99ec2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:03.373481 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fd4ed1c7-6585-4913-9319-160398a99ec2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:03.430245 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-4b64801b-356c-4f23-a819-44c68f6a1e7f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:03.430245 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-4b64801b-356c-4f23-a819-44c68f6a1e7f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:03.460588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4b64801b-356c-4f23-a819-44c68f6a1e7f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:03.463493 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4b64801b-356c-4f23-a819-44c68f6a1e7f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:03.466388 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4b64801b-356c-4f23-a819-44c68f6a1e7f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:03.471422 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4b64801b-356c-4f23-a819-44c68f6a1e7f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:03.472332 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4b64801b-356c-4f23-a819-44c68f6a1e7f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:03.472966 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4b64801b-356c-4f23-a819-44c68f6a1e7f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:04.015667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-4b64801b-356c-4f23-a819-44c68f6a1e7f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:04.026212 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-4b64801b-356c-4f23-a819-44c68f6a1e7f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:04.042210 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-4b64801b-356c-4f23-a819-44c68f6a1e7f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:04.042210 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-4b64801b-356c-4f23-a819-44c68f6a1e7f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1741 microversion: 2.20 time: 0.615100 Aug 24 13:41:04.042210 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 157/319] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:03 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1741 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:04.042453 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-fd4ed1c7-6585-4913-9319-160398a99ec2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:04.059190 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-fd4ed1c7-6585-4913-9319-160398a99ec2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.711179 Aug 24 13:41:04.060133 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 163/320] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:03 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:04.116588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-cff01d91-10ba-4ead-ba50-682f5e1eb8be tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:04.117368 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-cff01d91-10ba-4ead-ba50-682f5e1eb8be tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:04.130372 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cff01d91-10ba-4ead-ba50-682f5e1eb8be tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:04.130950 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cff01d91-10ba-4ead-ba50-682f5e1eb8be tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:04.133241 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cff01d91-10ba-4ead-ba50-682f5e1eb8be tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:04.134008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cff01d91-10ba-4ead-ba50-682f5e1eb8be tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:04.134486 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cff01d91-10ba-4ead-ba50-682f5e1eb8be tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:04.134920 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cff01d91-10ba-4ead-ba50-682f5e1eb8be tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:05.115569 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a929f2b1-9d4d-4dda-b0b8-39c6dec5e3d4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:05.116434 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-a929f2b1-9d4d-4dda-b0b8-39c6dec5e3d4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:05.133341 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a929f2b1-9d4d-4dda-b0b8-39c6dec5e3d4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:05.134263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a929f2b1-9d4d-4dda-b0b8-39c6dec5e3d4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:05.134858 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a929f2b1-9d4d-4dda-b0b8-39c6dec5e3d4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:05.135847 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a929f2b1-9d4d-4dda-b0b8-39c6dec5e3d4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:05.136401 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a929f2b1-9d4d-4dda-b0b8-39c6dec5e3d4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:05.136946 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a929f2b1-9d4d-4dda-b0b8-39c6dec5e3d4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:05.274968 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-cff01d91-10ba-4ead-ba50-682f5e1eb8be tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d0510b86c6444480ef4447a8a0a997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1804d01585764cf7bb02bd332a66573e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:05.306720 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-cff01d91-10ba-4ead-ba50-682f5e1eb8be tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240" status: 200 len: 1315 microversion: 2.1 time: 1.194061 Aug 24 13:41:05.313455 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 158/321] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:04 2022] GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 => generated 1315 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:05.333459 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-4bc967b5-2126-4bfb-9d41-58e06e69982e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:05.338436 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-4bc967b5-2126-4bfb-9d41-58e06e69982e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:05.366302 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4bc967b5-2126-4bfb-9d41-58e06e69982e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:05.367644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4bc967b5-2126-4bfb-9d41-58e06e69982e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:05.368707 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4bc967b5-2126-4bfb-9d41-58e06e69982e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:05.370385 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4bc967b5-2126-4bfb-9d41-58e06e69982e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:05.372317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4bc967b5-2126-4bfb-9d41-58e06e69982e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:05.373593 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4bc967b5-2126-4bfb-9d41-58e06e69982e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:06.002107 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-4bc967b5-2126-4bfb-9d41-58e06e69982e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:06.005124 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-a929f2b1-9d4d-4dda-b0b8-39c6dec5e3d4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:06.015466 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a929f2b1-9d4d-4dda-b0b8-39c6dec5e3d4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.904063 Aug 24 13:41:06.016648 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 164/322] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:05 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:06.032909 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-4bc967b5-2126-4bfb-9d41-58e06e69982e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:06.037055 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-4bc967b5-2126-4bfb-9d41-58e06e69982e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:06.041128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-4bc967b5-2126-4bfb-9d41-58e06e69982e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1723 microversion: 2.20 time: 0.724352 Aug 24 13:41:06.043902 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 159/323] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:05 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1723 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:06.350376 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-6f714f2d-30ad-4b29-9510-e438f75f540d tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:06.352243 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-6f714f2d-30ad-4b29-9510-e438f75f540d tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:06.366685 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f714f2d-30ad-4b29-9510-e438f75f540d tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:06.367397 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f714f2d-30ad-4b29-9510-e438f75f540d tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:06.368021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f714f2d-30ad-4b29-9510-e438f75f540d tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:06.368948 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f714f2d-30ad-4b29-9510-e438f75f540d tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:06.369578 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f714f2d-30ad-4b29-9510-e438f75f540d tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:06.370162 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f714f2d-30ad-4b29-9510-e438f75f540d tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:07.031911 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-6f714f2d-30ad-4b29-9510-e438f75f540d tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d0510b86c6444480ef4447a8a0a997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1804d01585764cf7bb02bd332a66573e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:07.040749 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-3d6e8352-1252-4a12-996e-c5e78c2bd4bf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:07.041443 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-3d6e8352-1252-4a12-996e-c5e78c2bd4bf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:07.045036 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-6f714f2d-30ad-4b29-9510-e438f75f540d tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240" status: 200 len: 1315 microversion: 2.1 time: 0.698356 Aug 24 13:41:07.045635 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 165/324] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:06 2022] GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 => generated 1315 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:07.063976 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3d6e8352-1252-4a12-996e-c5e78c2bd4bf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:07.065987 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3d6e8352-1252-4a12-996e-c5e78c2bd4bf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:07.066726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3d6e8352-1252-4a12-996e-c5e78c2bd4bf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:07.069345 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3d6e8352-1252-4a12-996e-c5e78c2bd4bf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:07.073844 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3d6e8352-1252-4a12-996e-c5e78c2bd4bf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:07.080037 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3d6e8352-1252-4a12-996e-c5e78c2bd4bf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:07.080230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-c44cc487-3e8d-4a05-9860-ecddb073acec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:07.080230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-c44cc487-3e8d-4a05-9860-ecddb073acec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:07.086619 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c44cc487-3e8d-4a05-9860-ecddb073acec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:07.093069 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c44cc487-3e8d-4a05-9860-ecddb073acec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:07.093919 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c44cc487-3e8d-4a05-9860-ecddb073acec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:07.094847 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c44cc487-3e8d-4a05-9860-ecddb073acec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:07.095924 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c44cc487-3e8d-4a05-9860-ecddb073acec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:07.098546 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c44cc487-3e8d-4a05-9860-ecddb073acec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:07.554651 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3d6e8352-1252-4a12-996e-c5e78c2bd4bf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:07.584677 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-3d6e8352-1252-4a12-996e-c5e78c2bd4bf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.548992 Aug 24 13:41:07.590756 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 160/325] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:07 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:41:07.630491 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c44cc487-3e8d-4a05-9860-ecddb073acec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:07.641936 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c44cc487-3e8d-4a05-9860-ecddb073acec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:07.643844 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c44cc487-3e8d-4a05-9860-ecddb073acec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:07.645124 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-c44cc487-3e8d-4a05-9860-ecddb073acec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1723 microversion: 2.20 time: 0.571921 Aug 24 13:41:07.645702 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 166/326] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:07 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1723 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:41:07.963702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-ab386e59-158e-4d90-b6db-9945a42334bf req-27c3033c-be3c-4455-829f-a419c87029fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfabd1a5-c2a2-414a-adc6-32693668f240", "name": "network-vif-plugged", "status": "completed", "tag": "0574bb60-a785-42a3-82cd-8678148d77ab"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:41:07.989511 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-ab386e59-158e-4d90-b6db-9945a42334bf req-27c3033c-be3c-4455-829f-a419c87029fa service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:07.990940 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-ab386e59-158e-4d90-b6db-9945a42334bf req-27c3033c-be3c-4455-829f-a419c87029fa service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:07.992284 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-ab386e59-158e-4d90-b6db-9945a42334bf req-27c3033c-be3c-4455-829f-a419c87029fa service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:08.022780 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-ab386e59-158e-4d90-b6db-9945a42334bf req-27c3033c-be3c-4455-829f-a419c87029fa service nova] Creating event network-vif-plugged:0574bb60-a785-42a3-82cd-8678148d77ab for instance dfabd1a5-c2a2-414a-adc6-32693668f240 on hv-cinder-77957 Aug 24 13:41:08.035644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-ab386e59-158e-4d90-b6db-9945a42334bf req-27c3033c-be3c-4455-829f-a419c87029fa service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091329 Aug 24 13:41:08.038048 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 161/327] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:41:08.079102 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-54dccd88-7801-416e-ac7b-903cd995e230 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:08.079102 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-54dccd88-7801-416e-ac7b-903cd995e230 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:08.092449 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-54dccd88-7801-416e-ac7b-903cd995e230 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:08.093667 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-54dccd88-7801-416e-ac7b-903cd995e230 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:08.094588 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-54dccd88-7801-416e-ac7b-903cd995e230 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:08.096104 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-54dccd88-7801-416e-ac7b-903cd995e230 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:08.097207 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-54dccd88-7801-416e-ac7b-903cd995e230 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:08.098146 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-54dccd88-7801-416e-ac7b-903cd995e230 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:08.464152 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-54dccd88-7801-416e-ac7b-903cd995e230 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d0510b86c6444480ef4447a8a0a997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1804d01585764cf7bb02bd332a66573e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:08.499319 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-54dccd88-7801-416e-ac7b-903cd995e230 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240" status: 200 len: 1315 microversion: 2.1 time: 0.424410 Aug 24 13:41:08.500527 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 167/328] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:08 2022] GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:08.633266 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-93054293-4bbf-4598-82db-cd840c0efc3a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:08.635353 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-93054293-4bbf-4598-82db-cd840c0efc3a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:08.648357 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-93054293-4bbf-4598-82db-cd840c0efc3a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:08.649534 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-93054293-4bbf-4598-82db-cd840c0efc3a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:08.650631 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-93054293-4bbf-4598-82db-cd840c0efc3a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:08.652064 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-93054293-4bbf-4598-82db-cd840c0efc3a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:08.653830 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-93054293-4bbf-4598-82db-cd840c0efc3a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:08.659337 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-93054293-4bbf-4598-82db-cd840c0efc3a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:08.677652 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a4d155e1-0c03-4f70-8fb4-3f1e9c3cda08 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:08.679054 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-a4d155e1-0c03-4f70-8fb4-3f1e9c3cda08 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:08.697117 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a4d155e1-0c03-4f70-8fb4-3f1e9c3cda08 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:08.697117 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a4d155e1-0c03-4f70-8fb4-3f1e9c3cda08 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:08.698451 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a4d155e1-0c03-4f70-8fb4-3f1e9c3cda08 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:08.700287 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a4d155e1-0c03-4f70-8fb4-3f1e9c3cda08 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:08.701128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a4d155e1-0c03-4f70-8fb4-3f1e9c3cda08 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:08.701792 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a4d155e1-0c03-4f70-8fb4-3f1e9c3cda08 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:09.411330 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-a4d155e1-0c03-4f70-8fb4-3f1e9c3cda08 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:09.445091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-a4d155e1-0c03-4f70-8fb4-3f1e9c3cda08 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:09.452433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-a4d155e1-0c03-4f70-8fb4-3f1e9c3cda08 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:09.456687 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a4d155e1-0c03-4f70-8fb4-3f1e9c3cda08 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1723 microversion: 2.20 time: 0.783467 Aug 24 13:41:09.471168 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 168/329] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:08 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1723 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:09.514818 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-93054293-4bbf-4598-82db-cd840c0efc3a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:09.534941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-93054293-4bbf-4598-82db-cd840c0efc3a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.900343 Aug 24 13:41:09.538417 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 162/330] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:08 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:09.574711 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b15ef23f-b941-4a83-a693-e49d08dd5099 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:09.580884 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b15ef23f-b941-4a83-a693-e49d08dd5099 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:09.599758 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b15ef23f-b941-4a83-a693-e49d08dd5099 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:09.600529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b15ef23f-b941-4a83-a693-e49d08dd5099 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:09.600982 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b15ef23f-b941-4a83-a693-e49d08dd5099 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:09.604931 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b15ef23f-b941-4a83-a693-e49d08dd5099 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:09.605534 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b15ef23f-b941-4a83-a693-e49d08dd5099 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:09.606027 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b15ef23f-b941-4a83-a693-e49d08dd5099 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:09.974523 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b15ef23f-b941-4a83-a693-e49d08dd5099 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d0510b86c6444480ef4447a8a0a997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1804d01585764cf7bb02bd332a66573e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:09.989059 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b15ef23f-b941-4a83-a693-e49d08dd5099 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240" status: 200 len: 1315 microversion: 2.1 time: 0.440913 Aug 24 13:41:10.003611 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 169/331] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:09 2022] GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:10.067227 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-2f76bc2f-a649-4ada-86d2-bbf9893106e3 req-eef1a034-16de-4534-89d1-50969dc9af5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53bade32-e7bf-4ace-9b68-0458f257feff", "name": "network-vif-unplugged", "status": "completed", "tag": "55484e25-34c8-469b-8598-d718e9469013"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:41:10.086963 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-2f76bc2f-a649-4ada-86d2-bbf9893106e3 req-eef1a034-16de-4534-89d1-50969dc9af5c service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:10.087837 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-2f76bc2f-a649-4ada-86d2-bbf9893106e3 req-eef1a034-16de-4534-89d1-50969dc9af5c service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:10.088796 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-2f76bc2f-a649-4ada-86d2-bbf9893106e3 req-eef1a034-16de-4534-89d1-50969dc9af5c service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:10.115006 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-2f76bc2f-a649-4ada-86d2-bbf9893106e3 req-eef1a034-16de-4534-89d1-50969dc9af5c service nova] Creating event network-vif-unplugged:55484e25-34c8-469b-8598-d718e9469013 for instance 53bade32-e7bf-4ace-9b68-0458f257feff on hv-cinder-77957 Aug 24 13:41:10.125767 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-2f76bc2f-a649-4ada-86d2-bbf9893106e3 req-eef1a034-16de-4534-89d1-50969dc9af5c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065501 Aug 24 13:41:10.127369 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 163/332] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:41:10.503459 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a0e50260-2b72-42da-8027-d946b76f1630 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:10.504516 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-a0e50260-2b72-42da-8027-d946b76f1630 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:10.515777 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a0e50260-2b72-42da-8027-d946b76f1630 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:10.516403 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a0e50260-2b72-42da-8027-d946b76f1630 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:10.517241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a0e50260-2b72-42da-8027-d946b76f1630 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:10.518139 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a0e50260-2b72-42da-8027-d946b76f1630 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:10.519197 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a0e50260-2b72-42da-8027-d946b76f1630 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:10.519625 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a0e50260-2b72-42da-8027-d946b76f1630 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:10.571779 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-4fb02c9a-bf18-42c2-acd7-f04e920d6940 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:10.576162 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-4fb02c9a-bf18-42c2-acd7-f04e920d6940 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:10.591377 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4fb02c9a-bf18-42c2-acd7-f04e920d6940 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:10.592608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4fb02c9a-bf18-42c2-acd7-f04e920d6940 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:10.593595 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4fb02c9a-bf18-42c2-acd7-f04e920d6940 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:10.595014 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4fb02c9a-bf18-42c2-acd7-f04e920d6940 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:10.597274 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4fb02c9a-bf18-42c2-acd7-f04e920d6940 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:10.598510 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4fb02c9a-bf18-42c2-acd7-f04e920d6940 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:10.663036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=100 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:41:10.858274 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-a0e50260-2b72-42da-8027-d946b76f1630 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:10.870688 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-a0e50260-2b72-42da-8027-d946b76f1630 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:10.874026 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-a0e50260-2b72-42da-8027-d946b76f1630 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:10.881222 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a0e50260-2b72-42da-8027-d946b76f1630 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1726 microversion: 2.20 time: 0.384263 Aug 24 13:41:10.881222 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 170/333] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:10 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1726 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:10.881481 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-4fb02c9a-bf18-42c2-acd7-f04e920d6940 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:10.889145 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-4fb02c9a-bf18-42c2-acd7-f04e920d6940 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.326372 Aug 24 13:41:10.891158 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 164/334] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:10 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:10.914203 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-babda3f4-f4a4-42f7-85fd-f9ba4c8ebae8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e9c9554-655b-40b3-9b28-6e8039294353"}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:41:10.917850 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-babda3f4-f4a4-42f7-85fd-f9ba4c8ebae8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:10.926423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-babda3f4-f4a4-42f7-85fd-f9ba4c8ebae8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:10.927051 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-babda3f4-f4a4-42f7-85fd-f9ba4c8ebae8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:10.927812 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-babda3f4-f4a4-42f7-85fd-f9ba4c8ebae8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:10.928742 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-babda3f4-f4a4-42f7-85fd-f9ba4c8ebae8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:10.929213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-babda3f4-f4a4-42f7-85fd-f9ba4c8ebae8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:10.929645 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-babda3f4-f4a4-42f7-85fd-f9ba4c8ebae8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:11.015052 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-3187bb7c-1425-466c-bf98-b38d70d803bb tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:11.018993 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-3187bb7c-1425-466c-bf98-b38d70d803bb tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:11.029247 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3187bb7c-1425-466c-bf98-b38d70d803bb tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:11.029959 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3187bb7c-1425-466c-bf98-b38d70d803bb tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:11.030480 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3187bb7c-1425-466c-bf98-b38d70d803bb tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:11.031747 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3187bb7c-1425-466c-bf98-b38d70d803bb tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:11.032506 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3187bb7c-1425-466c-bf98-b38d70d803bb tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:11.033581 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3187bb7c-1425-466c-bf98-b38d70d803bb tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:11.278562 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3187bb7c-1425-466c-bf98-b38d70d803bb tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d0510b86c6444480ef4447a8a0a997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1804d01585764cf7bb02bd332a66573e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:11.290963 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-3187bb7c-1425-466c-bf98-b38d70d803bb tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240" status: 200 len: 1315 microversion: 2.1 time: 0.283180 Aug 24 13:41:11.292589 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 165/335] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:11 2022] GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:41:11.916105 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a0ae371e-61ee-4d5f-ac1e-4e3652ba7552 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:11.917393 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a0ae371e-61ee-4d5f-ac1e-4e3652ba7552 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:11.929672 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a0ae371e-61ee-4d5f-ac1e-4e3652ba7552 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:11.930609 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a0ae371e-61ee-4d5f-ac1e-4e3652ba7552 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:11.931410 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a0ae371e-61ee-4d5f-ac1e-4e3652ba7552 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:11.933017 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a0ae371e-61ee-4d5f-ac1e-4e3652ba7552 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:11.933895 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a0ae371e-61ee-4d5f-ac1e-4e3652ba7552 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:11.935214 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a0ae371e-61ee-4d5f-ac1e-4e3652ba7552 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:12.145796 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a0ae371e-61ee-4d5f-ac1e-4e3652ba7552 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:12.163105 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a0ae371e-61ee-4d5f-ac1e-4e3652ba7552 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.253547 Aug 24 13:41:12.164791 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 166/336] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:11 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:12.342581 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-ac4b741a-0dbd-4add-8f50-c108be4afa6b tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:12.345124 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-ac4b741a-0dbd-4add-8f50-c108be4afa6b tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:12.363312 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ac4b741a-0dbd-4add-8f50-c108be4afa6b tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:12.365758 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ac4b741a-0dbd-4add-8f50-c108be4afa6b tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:12.366887 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ac4b741a-0dbd-4add-8f50-c108be4afa6b tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:12.373826 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ac4b741a-0dbd-4add-8f50-c108be4afa6b tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:12.374873 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ac4b741a-0dbd-4add-8f50-c108be4afa6b tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:12.375713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ac4b741a-0dbd-4add-8f50-c108be4afa6b tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:12.646979 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-ac4b741a-0dbd-4add-8f50-c108be4afa6b tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d0510b86c6444480ef4447a8a0a997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1804d01585764cf7bb02bd332a66573e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:12.656151 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-ac4b741a-0dbd-4add-8f50-c108be4afa6b tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240" status: 200 len: 1464 microversion: 2.1 time: 0.324631 Aug 24 13:41:12.656772 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 167/337] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:12 2022] GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 => generated 1464 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:12.820662 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-4314a204-f7b0-4f25-8446-c62f361bf341 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:12.823025 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-4314a204-f7b0-4f25-8446-c62f361bf341 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:12.860747 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4314a204-f7b0-4f25-8446-c62f361bf341 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:12.861347 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4314a204-f7b0-4f25-8446-c62f361bf341 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:12.861804 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4314a204-f7b0-4f25-8446-c62f361bf341 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:12.862606 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4314a204-f7b0-4f25-8446-c62f361bf341 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:12.863070 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4314a204-f7b0-4f25-8446-c62f361bf341 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:12.863496 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4314a204-f7b0-4f25-8446-c62f361bf341 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:12.902891 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-4314a204-f7b0-4f25-8446-c62f361bf341 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Going to try to terminate instance {{(pid=133014) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 13:41:12.913556 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-babda3f4-f4a4-42f7-85fd-f9ba4c8ebae8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "POST /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 2.004839 Aug 24 13:41:12.920658 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 171/338] 10.222.0.73 () {62 vars in 1364 bytes} [Wed Aug 24 13:41:10 2022] POST /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff/os-volume_attachments => generated 188 bytes in 2006 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 13:41:13.068439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=4 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:41:13.146180 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-f0138b24-45a1-4bfe-9eab-23a01c142b41 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:41:13.147473 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-f0138b24-45a1-4bfe-9eab-23a01c142b41 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:13.155787 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:41:13.164930 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f0138b24-45a1-4bfe-9eab-23a01c142b41 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:13.166112 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f0138b24-45a1-4bfe-9eab-23a01c142b41 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:13.167005 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f0138b24-45a1-4bfe-9eab-23a01c142b41 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:13.168927 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f0138b24-45a1-4bfe-9eab-23a01c142b41 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:13.169964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f0138b24-45a1-4bfe-9eab-23a01c142b41 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:13.171013 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f0138b24-45a1-4bfe-9eab-23a01c142b41 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:13.256756 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-f0138b24-45a1-4bfe-9eab-23a01c142b41 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=133015) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 13:41:13.565778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-4314a204-f7b0-4f25-8446-c62f361bf341 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "DELETE /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240" status: 204 len: 0 microversion: 2.1 time: 0.757769 Aug 24 13:41:13.569421 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 168/339] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:41:12 2022] DELETE /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 13:41:13.580106 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-6cd4049c-086b-4cf5-ae4b-ee2256ee93d3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:13.581779 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-6cd4049c-086b-4cf5-ae4b-ee2256ee93d3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:13.593076 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6cd4049c-086b-4cf5-ae4b-ee2256ee93d3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:13.595797 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6cd4049c-086b-4cf5-ae4b-ee2256ee93d3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:13.595797 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6cd4049c-086b-4cf5-ae4b-ee2256ee93d3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:13.597670 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6cd4049c-086b-4cf5-ae4b-ee2256ee93d3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:13.598745 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6cd4049c-086b-4cf5-ae4b-ee2256ee93d3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:13.599742 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6cd4049c-086b-4cf5-ae4b-ee2256ee93d3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:13.726925 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-f0138b24-45a1-4bfe-9eab-23a01c142b41 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "POST /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff/action" status: 202 len: 0 microversion: 2.20 time: 0.584842 Aug 24 13:41:13.733486 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 172/340] 10.222.0.73 () {62 vars in 1319 bytes} [Wed Aug 24 13:41:13 2022] POST /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:41:13.754455 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-c5743d04-8a0a-4863-8500-438696b49db9 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:13.756627 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-c5743d04-8a0a-4863-8500-438696b49db9 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:13.772801 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c5743d04-8a0a-4863-8500-438696b49db9 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:13.774221 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c5743d04-8a0a-4863-8500-438696b49db9 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:13.775014 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c5743d04-8a0a-4863-8500-438696b49db9 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:13.776646 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c5743d04-8a0a-4863-8500-438696b49db9 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:13.778766 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c5743d04-8a0a-4863-8500-438696b49db9 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:13.779790 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c5743d04-8a0a-4863-8500-438696b49db9 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:13.891081 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-6cd4049c-086b-4cf5-ae4b-ee2256ee93d3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:13.900149 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-6cd4049c-086b-4cf5-ae4b-ee2256ee93d3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.328504 Aug 24 13:41:13.917521 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 169/341] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:13 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:13.924231 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-65a908ec-0d9d-468c-aafa-306bba510048 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:13.925121 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-65a908ec-0d9d-468c-aafa-306bba510048 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:13.935064 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-65a908ec-0d9d-468c-aafa-306bba510048 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:13.935064 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-65a908ec-0d9d-468c-aafa-306bba510048 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:13.935844 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-65a908ec-0d9d-468c-aafa-306bba510048 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:13.936709 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-65a908ec-0d9d-468c-aafa-306bba510048 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:13.937280 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-65a908ec-0d9d-468c-aafa-306bba510048 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:13.937778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-65a908ec-0d9d-468c-aafa-306bba510048 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:14.107390 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c5743d04-8a0a-4863-8500-438696b49db9 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d0510b86c6444480ef4447a8a0a997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1804d01585764cf7bb02bd332a66573e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:14.120689 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-c5743d04-8a0a-4863-8500-438696b49db9 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240" status: 200 len: 1470 microversion: 2.1 time: 0.385098 Aug 24 13:41:14.137771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 173/342] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:13 2022] GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 => generated 1470 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:14.224042 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-65a908ec-0d9d-468c-aafa-306bba510048 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:14.224042 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-65a908ec-0d9d-468c-aafa-306bba510048 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:14.224708 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-65a908ec-0d9d-468c-aafa-306bba510048 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:14.224708 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-65a908ec-0d9d-468c-aafa-306bba510048 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1752 microversion: 2.20 time: 0.284834 Aug 24 13:41:14.224708 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 170/343] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:13 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1752 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:14.926121 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-f469241c-346f-44f2-9b90-b92aa2cea608 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:14.926642 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-f469241c-346f-44f2-9b90-b92aa2cea608 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:14.933433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f469241c-346f-44f2-9b90-b92aa2cea608 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:14.933925 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f469241c-346f-44f2-9b90-b92aa2cea608 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:14.935344 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f469241c-346f-44f2-9b90-b92aa2cea608 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:14.936345 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f469241c-346f-44f2-9b90-b92aa2cea608 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:14.936678 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f469241c-346f-44f2-9b90-b92aa2cea608 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:14.937118 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f469241c-346f-44f2-9b90-b92aa2cea608 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:14.962593 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:41:15.124404 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f469241c-346f-44f2-9b90-b92aa2cea608 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:15.134867 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-f469241c-346f-44f2-9b90-b92aa2cea608 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.212870 Aug 24 13:41:15.135662 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 174/344] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:14 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:15.160036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-38825f5c-8141-463a-b806-0ac8f68968ad tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:15.162135 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-38825f5c-8141-463a-b806-0ac8f68968ad tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:15.174340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-38825f5c-8141-463a-b806-0ac8f68968ad tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:15.175683 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-38825f5c-8141-463a-b806-0ac8f68968ad tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:15.176794 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-38825f5c-8141-463a-b806-0ac8f68968ad tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:15.177921 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-38825f5c-8141-463a-b806-0ac8f68968ad tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:15.179004 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-38825f5c-8141-463a-b806-0ac8f68968ad tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:15.180306 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-38825f5c-8141-463a-b806-0ac8f68968ad tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:15.252423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-0ff9c22b-c404-4950-b82a-aea1db3eee7d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:15.254470 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-0ff9c22b-c404-4950-b82a-aea1db3eee7d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:15.269356 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0ff9c22b-c404-4950-b82a-aea1db3eee7d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:15.275294 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0ff9c22b-c404-4950-b82a-aea1db3eee7d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:15.275294 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0ff9c22b-c404-4950-b82a-aea1db3eee7d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:15.275294 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0ff9c22b-c404-4950-b82a-aea1db3eee7d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:15.275294 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0ff9c22b-c404-4950-b82a-aea1db3eee7d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:15.277084 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0ff9c22b-c404-4950-b82a-aea1db3eee7d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:15.462872 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-38825f5c-8141-463a-b806-0ac8f68968ad tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d0510b86c6444480ef4447a8a0a997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1804d01585764cf7bb02bd332a66573e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:15.475165 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-38825f5c-8141-463a-b806-0ac8f68968ad tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240" status: 200 len: 1470 microversion: 2.1 time: 0.324106 Aug 24 13:41:15.475768 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 171/345] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:15 2022] GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 => generated 1470 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:15.513732 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-0ff9c22b-c404-4950-b82a-aea1db3eee7d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:15.525938 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-0ff9c22b-c404-4950-b82a-aea1db3eee7d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:15.527346 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-0ff9c22b-c404-4950-b82a-aea1db3eee7d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:15.529082 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-0ff9c22b-c404-4950-b82a-aea1db3eee7d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1752 microversion: 2.20 time: 0.284457 Aug 24 13:41:15.529937 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 175/346] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:15 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1752 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:41:16.163769 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a2ec9195-b68d-47d0-8b6a-659499b8a5cd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:16.164557 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a2ec9195-b68d-47d0-8b6a-659499b8a5cd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:16.175830 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a2ec9195-b68d-47d0-8b6a-659499b8a5cd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:16.176369 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a2ec9195-b68d-47d0-8b6a-659499b8a5cd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:16.176822 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a2ec9195-b68d-47d0-8b6a-659499b8a5cd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:16.181529 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a2ec9195-b68d-47d0-8b6a-659499b8a5cd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:16.182217 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a2ec9195-b68d-47d0-8b6a-659499b8a5cd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:16.182835 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a2ec9195-b68d-47d0-8b6a-659499b8a5cd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:16.491815 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a2ec9195-b68d-47d0-8b6a-659499b8a5cd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:16.498897 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-cf705c4c-f3a4-4e3e-abd6-6592566840f5 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:16.499688 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-cf705c4c-f3a4-4e3e-abd6-6592566840f5 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:16.506428 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a2ec9195-b68d-47d0-8b6a-659499b8a5cd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.348246 Aug 24 13:41:16.520585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cf705c4c-f3a4-4e3e-abd6-6592566840f5 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:16.520585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cf705c4c-f3a4-4e3e-abd6-6592566840f5 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:16.520585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cf705c4c-f3a4-4e3e-abd6-6592566840f5 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:16.520585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cf705c4c-f3a4-4e3e-abd6-6592566840f5 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:16.520983 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cf705c4c-f3a4-4e3e-abd6-6592566840f5 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:16.520983 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cf705c4c-f3a4-4e3e-abd6-6592566840f5 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:16.521654 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 172/347] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:16 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:41:16.560824 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-96eebe3f-274b-4cf9-a946-257e6f0fc487 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:16.561927 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-96eebe3f-274b-4cf9-a946-257e6f0fc487 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:16.575136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-96eebe3f-274b-4cf9-a946-257e6f0fc487 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:16.590824 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-96eebe3f-274b-4cf9-a946-257e6f0fc487 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:16.590824 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-96eebe3f-274b-4cf9-a946-257e6f0fc487 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:16.590824 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-96eebe3f-274b-4cf9-a946-257e6f0fc487 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:16.601062 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-96eebe3f-274b-4cf9-a946-257e6f0fc487 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:16.601924 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-96eebe3f-274b-4cf9-a946-257e6f0fc487 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:16.941442 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-cf705c4c-f3a4-4e3e-abd6-6592566840f5 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d0510b86c6444480ef4447a8a0a997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1804d01585764cf7bb02bd332a66573e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:16.957006 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-96eebe3f-274b-4cf9-a946-257e6f0fc487 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:16.962635 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-cf705c4c-f3a4-4e3e-abd6-6592566840f5 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240" status: 200 len: 1470 microversion: 2.1 time: 0.466573 Aug 24 13:41:16.963550 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 176/348] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:16 2022] GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 => generated 1470 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:16.984411 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-96eebe3f-274b-4cf9-a946-257e6f0fc487 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:16.986396 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-96eebe3f-274b-4cf9-a946-257e6f0fc487 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:16.987780 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-96eebe3f-274b-4cf9-a946-257e6f0fc487 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1752 microversion: 2.20 time: 0.432424 Aug 24 13:41:16.988552 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 173/349] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:16 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1752 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:17.257286 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-9daed522-be15-4b93-b9c7-0c30409dcb4a req-0b714a73-f000-4e32-9866-5d8111e80618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfabd1a5-c2a2-414a-adc6-32693668f240", "name": "network-vif-deleted", "tag": "0574bb60-a785-42a3-82cd-8678148d77ab"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:41:17.270749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-9daed522-be15-4b93-b9c7-0c30409dcb4a req-0b714a73-f000-4e32-9866-5d8111e80618 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:17.271598 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-9daed522-be15-4b93-b9c7-0c30409dcb4a req-0b714a73-f000-4e32-9866-5d8111e80618 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:17.272300 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-9daed522-be15-4b93-b9c7-0c30409dcb4a req-0b714a73-f000-4e32-9866-5d8111e80618 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:17.290350 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-9daed522-be15-4b93-b9c7-0c30409dcb4a req-0b714a73-f000-4e32-9866-5d8111e80618 service nova] Creating event network-vif-deleted:0574bb60-a785-42a3-82cd-8678148d77ab for instance dfabd1a5-c2a2-414a-adc6-32693668f240 on hv-cinder-77957 Aug 24 13:41:17.302432 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-9daed522-be15-4b93-b9c7-0c30409dcb4a req-0b714a73-f000-4e32-9866-5d8111e80618 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050599 Aug 24 13:41:17.303447 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 177/350] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:41:17.538551 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-9d7471a5-5707-47a4-8df1-bad4e31b83d9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:17.539750 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-9d7471a5-5707-47a4-8df1-bad4e31b83d9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:17.546963 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:41:17.555006 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d7471a5-5707-47a4-8df1-bad4e31b83d9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:17.556232 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d7471a5-5707-47a4-8df1-bad4e31b83d9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:17.557211 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d7471a5-5707-47a4-8df1-bad4e31b83d9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:17.563478 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d7471a5-5707-47a4-8df1-bad4e31b83d9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:17.564347 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d7471a5-5707-47a4-8df1-bad4e31b83d9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:17.565102 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d7471a5-5707-47a4-8df1-bad4e31b83d9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:17.871057 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-9d7471a5-5707-47a4-8df1-bad4e31b83d9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:17.886316 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-9d7471a5-5707-47a4-8df1-bad4e31b83d9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.354847 Aug 24 13:41:17.888383 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 174/351] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:17 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:17.991894 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d850b570-1778-4ec3-ac1a-d6e10b1f316c tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:17.994383 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-d850b570-1778-4ec3-ac1a-d6e10b1f316c tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:18.022999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d850b570-1778-4ec3-ac1a-d6e10b1f316c tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:18.023615 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d850b570-1778-4ec3-ac1a-d6e10b1f316c tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:18.024132 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d850b570-1778-4ec3-ac1a-d6e10b1f316c tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:18.024585 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e309fd32-59c0-4450-88b7-6eb455b26aad tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:18.025567 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d850b570-1778-4ec3-ac1a-d6e10b1f316c tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:18.026105 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d850b570-1778-4ec3-ac1a-d6e10b1f316c tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:18.026529 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-e309fd32-59c0-4450-88b7-6eb455b26aad tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:18.026700 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d850b570-1778-4ec3-ac1a-d6e10b1f316c tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:18.041305 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e309fd32-59c0-4450-88b7-6eb455b26aad tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:18.042588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e309fd32-59c0-4450-88b7-6eb455b26aad tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:18.043912 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e309fd32-59c0-4450-88b7-6eb455b26aad tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:18.045303 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e309fd32-59c0-4450-88b7-6eb455b26aad tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:18.046523 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e309fd32-59c0-4450-88b7-6eb455b26aad tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:18.047257 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e309fd32-59c0-4450-88b7-6eb455b26aad tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:18.077670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d850b570-1778-4ec3-ac1a-d6e10b1f316c tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:18.078568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d850b570-1778-4ec3-ac1a-d6e10b1f316c tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:18.079273 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d850b570-1778-4ec3-ac1a-d6e10b1f316c tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:18.080404 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.objects.instance [None req-d850b570-1778-4ec3-ac1a-d6e10b1f316c tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lazy-loading 'fault' on Instance uuid dfabd1a5-c2a2-414a-adc6-32693668f240 {{(pid=133015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:41:18.134291 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d850b570-1778-4ec3-ac1a-d6e10b1f316c tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16d0510b86c6444480ef4447a8a0a997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1804d01585764cf7bb02bd332a66573e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:18.150420 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-d850b570-1778-4ec3-ac1a-d6e10b1f316c tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240" status: 200 len: 1305 microversion: 2.1 time: 0.166352 Aug 24 13:41:18.151462 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 178/352] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:17 2022] GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 => generated 1305 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:41:18.335383 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e309fd32-59c0-4450-88b7-6eb455b26aad tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:18.357051 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e309fd32-59c0-4450-88b7-6eb455b26aad tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:18.360063 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e309fd32-59c0-4450-88b7-6eb455b26aad tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:18.361652 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-e309fd32-59c0-4450-88b7-6eb455b26aad tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1752 microversion: 2.20 time: 0.345736 Aug 24 13:41:18.378047 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 175/353] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:18 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1752 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:41:18.919037 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-db1ceb96-4b81-43a3-ab22-b474b28f72db tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:18.920400 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-db1ceb96-4b81-43a3-ab22-b474b28f72db tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:18.941210 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-db1ceb96-4b81-43a3-ab22-b474b28f72db tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:18.942231 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-db1ceb96-4b81-43a3-ab22-b474b28f72db tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:18.943161 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-db1ceb96-4b81-43a3-ab22-b474b28f72db tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:18.944272 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-db1ceb96-4b81-43a3-ab22-b474b28f72db tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:18.944792 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-db1ceb96-4b81-43a3-ab22-b474b28f72db tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:18.945400 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-db1ceb96-4b81-43a3-ab22-b474b28f72db tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:19.148271 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-db1ceb96-4b81-43a3-ab22-b474b28f72db tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:19.159341 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-db1ceb96-4b81-43a3-ab22-b474b28f72db tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.244708 Aug 24 13:41:19.160506 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 179/354] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:18 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:41:19.174300 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-37133346-7eee-4644-bb62-d12609c84fe0 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:19.175676 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-37133346-7eee-4644-bb62-d12609c84fe0 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] [instance: dfabd1a5-c2a2-414a-adc6-32693668f240] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:19.182892 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-37133346-7eee-4644-bb62-d12609c84fe0 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:19.183765 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-37133346-7eee-4644-bb62-d12609c84fe0 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:19.184748 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-37133346-7eee-4644-bb62-d12609c84fe0 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:19.185944 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-37133346-7eee-4644-bb62-d12609c84fe0 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:19.186632 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-37133346-7eee-4644-bb62-d12609c84fe0 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:19.187152 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-37133346-7eee-4644-bb62-d12609c84fe0 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:19.208922 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-37133346-7eee-4644-bb62-d12609c84fe0 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] HTTP exception thrown: Instance dfabd1a5-c2a2-414a-adc6-32693668f240 could not be found. Aug 24 13:41:19.211008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-37133346-7eee-4644-bb62-d12609c84fe0 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Request method failure captured: Aug 24 13:41:19.211008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 HTTP/1.1 Aug 24 13:41:19.211008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:41:19.211008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:41:19.211008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:41:19.211008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:41:19.211008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:41:19.211008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:41:19.211008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:41:19.211008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:41:19.211008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBipWK4ZC70225xrHow4rWsxE_YWPDdHlELaAGg_reCJShFQehUR2IedcP1Ixi5Jk5Y4TRzie0U6K88e3HDAqG6Ieyhf2JJd5Gd6SNA3CgFuFrFtxAstLWaHkDvWf_3sWEuHem9iRn6hLkvNoYhwk3S3h5skI8sV4uvHvZj4TXPECQmI Aug 24 13:41:19.211008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:41:19.211008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:41:19.211008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:41:19.211008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:41:19.211008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:41:19.211008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:41:19.211008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 1804d01585764cf7bb02bd332a66573e Aug 24 13:41:19.211008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-VolumesNegativeTest-114085999 Aug 24 13:41:19.211008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:41:19.211008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:41:19.212699 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1804d01585764cf7bb02bd332a66573e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1804d01585764cf7bb02bd332a66573e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1804d01585764cf7bb02bd332a66573e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1804d01585764cf7bb02bd332a66573e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:41:19.212699 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-VolumesNegativeTest-114085999 Aug 24 13:41:19.212699 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 1804d01585764cf7bb02bd332a66573e Aug 24 13:41:19.212699 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-VolumesNegativeTest-114085999 Aug 24 13:41:19.212699 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-VolumesNegativeTest-114085999-project Aug 24 13:41:19.212699 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:41:19.212699 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:41:19.212699 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: 16d0510b86c6444480ef4447a8a0a997 Aug 24 13:41:19.212699 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-VolumesNegativeTest-114085999-project Aug 24 13:41:19.212699 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:41:19.212699 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Instance dfabd1a5-c2a2-414a-adc6-32693668f240 could not be found. Aug 24 13:41:19.212699 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': 'dfabd1a5-c2a2-414a-adc6-32693668f240'} Aug 24 13:41:19.213578 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:41:19.213578 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:41:19.213578 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:41:19.213578 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:41:19.213578 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:41:19.213578 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:41:19.213578 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:41:19.213578 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:41:19.213578 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:41:19.213578 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:41:19.213578 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfabd1a5-c2a2-414a-adc6-32693668f240 could not be found. Aug 24 13:41:19.213578 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:41:19.213578 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:41:19.213578 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:41:19.213578 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:41:19.213578 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:41:19.213578 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:41:19.213578 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:41:19.213578 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:41:19.213578 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:41:19.216194 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:41:19.216194 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:41:19.216194 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:41:19.216194 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:41:19.216194 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:41:19.216194 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:41:19.216194 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:41:19.216194 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfabd1a5-c2a2-414a-adc6-32693668f240 could not be found. Aug 24 13:41:19.216194 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:41:19.216194 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:41:19.216194 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:41:19.216194 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:41:19.216194 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:41:19.216194 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:41:19.216194 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:41:19.216194 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:41:19.216194 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfabd1a5-c2a2-414a-adc6-32693668f240 could not be found. Aug 24 13:41:19.216194 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:41:19.217535 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-37133346-7eee-4644-bb62-d12609c84fe0 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] Returning 404 to user: Instance dfabd1a5-c2a2-414a-adc6-32693668f240 could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:41:19.217535 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-37133346-7eee-4644-bb62-d12609c84fe0 tempest-VolumesNegativeTest-114085999 tempest-VolumesNegativeTest-114085999-project] 10.222.0.73 "GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240" status: 404 len: 111 microversion: 2.1 time: 0.042503 Aug 24 13:41:19.217535 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 176/355] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:19 2022] GET /compute/v2.1/servers/dfabd1a5-c2a2-414a-adc6-32693668f240 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:41:19.388046 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-9cc2f008-fcfd-4fb4-b0d6-9ede5aa64709 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:19.389068 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-9cc2f008-fcfd-4fb4-b0d6-9ede5aa64709 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:19.395858 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9cc2f008-fcfd-4fb4-b0d6-9ede5aa64709 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:19.396510 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9cc2f008-fcfd-4fb4-b0d6-9ede5aa64709 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:19.397016 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9cc2f008-fcfd-4fb4-b0d6-9ede5aa64709 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:19.397922 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9cc2f008-fcfd-4fb4-b0d6-9ede5aa64709 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:19.398617 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9cc2f008-fcfd-4fb4-b0d6-9ede5aa64709 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:19.399305 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9cc2f008-fcfd-4fb4-b0d6-9ede5aa64709 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:19.598301 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-9cc2f008-fcfd-4fb4-b0d6-9ede5aa64709 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:19.612410 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-9cc2f008-fcfd-4fb4-b0d6-9ede5aa64709 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:19.613969 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-9cc2f008-fcfd-4fb4-b0d6-9ede5aa64709 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:19.615462 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-9cc2f008-fcfd-4fb4-b0d6-9ede5aa64709 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1752 microversion: 2.20 time: 0.231546 Aug 24 13:41:19.616172 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 180/356] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:19 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1752 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:20.183360 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a25d9b47-babd-451d-84b9-34566a17dbf9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:20.184047 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a25d9b47-babd-451d-84b9-34566a17dbf9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:20.191979 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a25d9b47-babd-451d-84b9-34566a17dbf9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:20.193022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a25d9b47-babd-451d-84b9-34566a17dbf9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:20.193672 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a25d9b47-babd-451d-84b9-34566a17dbf9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:20.194602 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a25d9b47-babd-451d-84b9-34566a17dbf9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:20.195256 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a25d9b47-babd-451d-84b9-34566a17dbf9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:20.195861 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a25d9b47-babd-451d-84b9-34566a17dbf9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:20.444674 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a25d9b47-babd-451d-84b9-34566a17dbf9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:20.461766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a25d9b47-babd-451d-84b9-34566a17dbf9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.282215 Aug 24 13:41:20.462394 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 177/357] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:20 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:20.642317 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-9c100eb1-028c-487a-969d-2438bf0112e9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:20.643205 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-9c100eb1-028c-487a-969d-2438bf0112e9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:20.653428 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9c100eb1-028c-487a-969d-2438bf0112e9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:20.654192 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9c100eb1-028c-487a-969d-2438bf0112e9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:20.654716 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9c100eb1-028c-487a-969d-2438bf0112e9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:20.655595 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9c100eb1-028c-487a-969d-2438bf0112e9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:20.656309 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9c100eb1-028c-487a-969d-2438bf0112e9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:20.656847 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9c100eb1-028c-487a-969d-2438bf0112e9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:20.910895 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-9c100eb1-028c-487a-969d-2438bf0112e9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:20.921677 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-9c100eb1-028c-487a-969d-2438bf0112e9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:20.923547 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-9c100eb1-028c-487a-969d-2438bf0112e9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:20.925218 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-9c100eb1-028c-487a-969d-2438bf0112e9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1752 microversion: 2.20 time: 0.289794 Aug 24 13:41:20.941103 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 181/358] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:20 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1752 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:21.495150 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-4aef9080-6a84-42b6-9a3d-4ac4bad8e488 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:21.495992 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-4aef9080-6a84-42b6-9a3d-4ac4bad8e488 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:21.506296 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4aef9080-6a84-42b6-9a3d-4ac4bad8e488 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:21.506999 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4aef9080-6a84-42b6-9a3d-4ac4bad8e488 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:21.507739 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4aef9080-6a84-42b6-9a3d-4ac4bad8e488 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:21.508716 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4aef9080-6a84-42b6-9a3d-4ac4bad8e488 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:21.509292 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4aef9080-6a84-42b6-9a3d-4ac4bad8e488 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:21.509979 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4aef9080-6a84-42b6-9a3d-4ac4bad8e488 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:21.708541 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-4aef9080-6a84-42b6-9a3d-4ac4bad8e488 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:21.727937 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-4aef9080-6a84-42b6-9a3d-4ac4bad8e488 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.238269 Aug 24 13:41:21.727937 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 178/359] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:21 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:21.953799 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-392b8a5a-bd06-4313-9cd4-cfb4c4e6bf8d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:21.954733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-392b8a5a-bd06-4313-9cd4-cfb4c4e6bf8d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:21.962716 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-392b8a5a-bd06-4313-9cd4-cfb4c4e6bf8d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:21.965069 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-392b8a5a-bd06-4313-9cd4-cfb4c4e6bf8d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:21.965069 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-392b8a5a-bd06-4313-9cd4-cfb4c4e6bf8d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:21.965069 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-392b8a5a-bd06-4313-9cd4-cfb4c4e6bf8d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:21.966115 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-392b8a5a-bd06-4313-9cd4-cfb4c4e6bf8d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:21.967010 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-392b8a5a-bd06-4313-9cd4-cfb4c4e6bf8d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:22.167349 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-392b8a5a-bd06-4313-9cd4-cfb4c4e6bf8d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:22.187226 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-392b8a5a-bd06-4313-9cd4-cfb4c4e6bf8d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:22.189030 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-392b8a5a-bd06-4313-9cd4-cfb4c4e6bf8d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:22.190456 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-392b8a5a-bd06-4313-9cd4-cfb4c4e6bf8d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1752 microversion: 2.20 time: 0.242160 Aug 24 13:41:22.191558 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 182/360] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:21 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1752 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:41:22.759747 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-b6f20178-2a9e-4bf0-b566-53e0b17bdc30 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:22.760445 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-b6f20178-2a9e-4bf0-b566-53e0b17bdc30 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:22.771384 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b6f20178-2a9e-4bf0-b566-53e0b17bdc30 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:22.774035 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b6f20178-2a9e-4bf0-b566-53e0b17bdc30 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:22.774837 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b6f20178-2a9e-4bf0-b566-53e0b17bdc30 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:22.775709 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b6f20178-2a9e-4bf0-b566-53e0b17bdc30 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:22.776171 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b6f20178-2a9e-4bf0-b566-53e0b17bdc30 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:22.776590 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b6f20178-2a9e-4bf0-b566-53e0b17bdc30 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:22.978281 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-b6f20178-2a9e-4bf0-b566-53e0b17bdc30 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:22.990723 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-b6f20178-2a9e-4bf0-b566-53e0b17bdc30 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.236378 Aug 24 13:41:22.991488 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 179/361] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:22 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:23.225101 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-97a86c45-282d-42da-bfd9-331368b9392f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:23.228545 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-97a86c45-282d-42da-bfd9-331368b9392f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:23.257606 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-97a86c45-282d-42da-bfd9-331368b9392f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:23.258106 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-97a86c45-282d-42da-bfd9-331368b9392f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:23.258543 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-97a86c45-282d-42da-bfd9-331368b9392f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:23.259261 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-97a86c45-282d-42da-bfd9-331368b9392f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:23.259715 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-97a86c45-282d-42da-bfd9-331368b9392f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:23.260147 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-97a86c45-282d-42da-bfd9-331368b9392f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:23.500234 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-97a86c45-282d-42da-bfd9-331368b9392f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:23.509950 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-97a86c45-282d-42da-bfd9-331368b9392f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:23.511520 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-97a86c45-282d-42da-bfd9-331368b9392f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:23.513730 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-97a86c45-282d-42da-bfd9-331368b9392f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1752 microversion: 2.20 time: 0.298427 Aug 24 13:41:23.514334 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 183/362] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:23 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1752 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:24.020136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-6356bf13-997d-4b30-a164-b968573a8558 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:24.023601 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-6356bf13-997d-4b30-a164-b968573a8558 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:24.034771 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6356bf13-997d-4b30-a164-b968573a8558 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:24.037768 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6356bf13-997d-4b30-a164-b968573a8558 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:24.037768 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6356bf13-997d-4b30-a164-b968573a8558 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:24.037768 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6356bf13-997d-4b30-a164-b968573a8558 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:24.037768 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6356bf13-997d-4b30-a164-b968573a8558 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:24.038463 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6356bf13-997d-4b30-a164-b968573a8558 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:24.044028 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:41:24.279140 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-6356bf13-997d-4b30-a164-b968573a8558 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:24.295049 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-6356bf13-997d-4b30-a164-b968573a8558 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.283431 Aug 24 13:41:24.313035 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 180/363] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:24 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:24.559535 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-de61b9f9-cc5c-49c7-b1a2-f65642e15105 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:24.570204 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-de61b9f9-cc5c-49c7-b1a2-f65642e15105 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:24.601862 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-de61b9f9-cc5c-49c7-b1a2-f65642e15105 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:24.602767 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-de61b9f9-cc5c-49c7-b1a2-f65642e15105 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:24.603455 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-de61b9f9-cc5c-49c7-b1a2-f65642e15105 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:24.604504 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-de61b9f9-cc5c-49c7-b1a2-f65642e15105 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:24.605639 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-de61b9f9-cc5c-49c7-b1a2-f65642e15105 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:24.606412 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-de61b9f9-cc5c-49c7-b1a2-f65642e15105 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:24.817328 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-de61b9f9-cc5c-49c7-b1a2-f65642e15105 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:24.836385 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-de61b9f9-cc5c-49c7-b1a2-f65642e15105 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:24.839082 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-de61b9f9-cc5c-49c7-b1a2-f65642e15105 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:24.840995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-de61b9f9-cc5c-49c7-b1a2-f65642e15105 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1752 microversion: 2.20 time: 0.291576 Aug 24 13:41:24.842010 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 184/364] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:24 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1752 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:25.321521 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-eace50cb-7efa-475a-847c-67784b866c49 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:25.322345 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-eace50cb-7efa-475a-847c-67784b866c49 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:25.330742 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eace50cb-7efa-475a-847c-67784b866c49 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:25.331627 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eace50cb-7efa-475a-847c-67784b866c49 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:25.332367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eace50cb-7efa-475a-847c-67784b866c49 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:25.333310 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eace50cb-7efa-475a-847c-67784b866c49 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:25.333995 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eace50cb-7efa-475a-847c-67784b866c49 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:25.334501 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eace50cb-7efa-475a-847c-67784b866c49 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:25.572849 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-eace50cb-7efa-475a-847c-67784b866c49 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:25.584977 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-eace50cb-7efa-475a-847c-67784b866c49 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1522 microversion: 2.1 time: 0.268561 Aug 24 13:41:25.587726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 181/365] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:25 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:25.864967 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-43582432-e62b-40fc-8299-80304a557cc0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:25.866351 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-43582432-e62b-40fc-8299-80304a557cc0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:25.875155 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-43582432-e62b-40fc-8299-80304a557cc0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:25.876012 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-43582432-e62b-40fc-8299-80304a557cc0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:25.876681 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-43582432-e62b-40fc-8299-80304a557cc0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:25.877691 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-43582432-e62b-40fc-8299-80304a557cc0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:25.878364 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-43582432-e62b-40fc-8299-80304a557cc0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:25.879387 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-43582432-e62b-40fc-8299-80304a557cc0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:26.058372 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-43582432-e62b-40fc-8299-80304a557cc0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:26.073912 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-43582432-e62b-40fc-8299-80304a557cc0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:26.075885 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-43582432-e62b-40fc-8299-80304a557cc0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:26.077281 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-43582432-e62b-40fc-8299-80304a557cc0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1754 microversion: 2.20 time: 0.216304 Aug 24 13:41:26.077847 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 185/366] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:25 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1754 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:26.611610 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-2180cd4e-3c7c-414c-ace8-a4bdf45e133f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:26.612330 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-2180cd4e-3c7c-414c-ace8-a4bdf45e133f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:26.618613 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2180cd4e-3c7c-414c-ace8-a4bdf45e133f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:26.620627 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2180cd4e-3c7c-414c-ace8-a4bdf45e133f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:26.620627 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2180cd4e-3c7c-414c-ace8-a4bdf45e133f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:26.620627 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2180cd4e-3c7c-414c-ace8-a4bdf45e133f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:26.621953 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2180cd4e-3c7c-414c-ace8-a4bdf45e133f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:26.622600 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2180cd4e-3c7c-414c-ace8-a4bdf45e133f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:26.803374 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-2180cd4e-3c7c-414c-ace8-a4bdf45e133f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:26.817962 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-2180cd4e-3c7c-414c-ace8-a4bdf45e133f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1502 microversion: 2.1 time: 0.212192 Aug 24 13:41:26.825109 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 182/367] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:26 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1502 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:26.847472 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-905e98ff-9299-47c0-9472-fc7e7949b300 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:26.848419 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-905e98ff-9299-47c0-9472-fc7e7949b300 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:26.857256 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-905e98ff-9299-47c0-9472-fc7e7949b300 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:26.859058 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-905e98ff-9299-47c0-9472-fc7e7949b300 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:26.859058 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-905e98ff-9299-47c0-9472-fc7e7949b300 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:26.859058 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-905e98ff-9299-47c0-9472-fc7e7949b300 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:26.859319 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-905e98ff-9299-47c0-9472-fc7e7949b300 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:26.859853 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-905e98ff-9299-47c0-9472-fc7e7949b300 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:27.016726 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-905e98ff-9299-47c0-9472-fc7e7949b300 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:27.025948 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-905e98ff-9299-47c0-9472-fc7e7949b300 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1516 microversion: 2.1 time: 0.183101 Aug 24 13:41:27.043583 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 186/368] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:26 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1516 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:27.103030 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-bb3306f1-e314-4bd2-8d47-7a5a33fe9e46 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:27.103727 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-bb3306f1-e314-4bd2-8d47-7a5a33fe9e46 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:27.120408 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bb3306f1-e314-4bd2-8d47-7a5a33fe9e46 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:27.120883 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bb3306f1-e314-4bd2-8d47-7a5a33fe9e46 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:27.127468 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bb3306f1-e314-4bd2-8d47-7a5a33fe9e46 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:27.128406 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bb3306f1-e314-4bd2-8d47-7a5a33fe9e46 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:27.128918 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bb3306f1-e314-4bd2-8d47-7a5a33fe9e46 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:27.129390 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bb3306f1-e314-4bd2-8d47-7a5a33fe9e46 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:27.314890 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-bb3306f1-e314-4bd2-8d47-7a5a33fe9e46 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:27.332594 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-bb3306f1-e314-4bd2-8d47-7a5a33fe9e46 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:27.336809 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-bb3306f1-e314-4bd2-8d47-7a5a33fe9e46 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:27.340410 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-bb3306f1-e314-4bd2-8d47-7a5a33fe9e46 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1754 microversion: 2.20 time: 0.240708 Aug 24 13:41:27.344681 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 183/369] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:27 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1754 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:28.372875 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-6cd54603-d76e-49db-a0e1-d73fdc34c3c0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:28.373973 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-6cd54603-d76e-49db-a0e1-d73fdc34c3c0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:28.380866 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6cd54603-d76e-49db-a0e1-d73fdc34c3c0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:28.381459 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6cd54603-d76e-49db-a0e1-d73fdc34c3c0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:28.381969 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6cd54603-d76e-49db-a0e1-d73fdc34c3c0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:28.382718 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6cd54603-d76e-49db-a0e1-d73fdc34c3c0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:28.383192 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6cd54603-d76e-49db-a0e1-d73fdc34c3c0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:28.383610 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6cd54603-d76e-49db-a0e1-d73fdc34c3c0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:28.536808 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-6cd54603-d76e-49db-a0e1-d73fdc34c3c0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:28.554167 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-6cd54603-d76e-49db-a0e1-d73fdc34c3c0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:28.556613 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-6cd54603-d76e-49db-a0e1-d73fdc34c3c0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:28.558883 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-6cd54603-d76e-49db-a0e1-d73fdc34c3c0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1754 microversion: 2.20 time: 0.190144 Aug 24 13:41:28.576209 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 187/370] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:28 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1754 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:29.587485 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-4c5b95ba-02d1-4948-aa6d-f19963749e07 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:29.588090 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-4c5b95ba-02d1-4948-aa6d-f19963749e07 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:29.595663 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4c5b95ba-02d1-4948-aa6d-f19963749e07 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:29.596159 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4c5b95ba-02d1-4948-aa6d-f19963749e07 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:29.596626 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4c5b95ba-02d1-4948-aa6d-f19963749e07 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:29.597334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4c5b95ba-02d1-4948-aa6d-f19963749e07 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:29.597792 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4c5b95ba-02d1-4948-aa6d-f19963749e07 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:29.598222 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4c5b95ba-02d1-4948-aa6d-f19963749e07 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:29.945110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-4c5b95ba-02d1-4948-aa6d-f19963749e07 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:29.958017 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-dd4798a2-3d26-4465-8b2d-d4c494e95c2f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:41:29.962552 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-dd4798a2-3d26-4465-8b2d-d4c494e95c2f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:29.962726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-4c5b95ba-02d1-4948-aa6d-f19963749e07 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:29.963568 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-4c5b95ba-02d1-4948-aa6d-f19963749e07 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:29.965247 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-4c5b95ba-02d1-4948-aa6d-f19963749e07 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.381308 Aug 24 13:41:29.966153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 184/371] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:29 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:29.984692 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dd4798a2-3d26-4465-8b2d-d4c494e95c2f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:29.990502 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dd4798a2-3d26-4465-8b2d-d4c494e95c2f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:29.990502 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dd4798a2-3d26-4465-8b2d-d4c494e95c2f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:29.990502 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dd4798a2-3d26-4465-8b2d-d4c494e95c2f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:29.990502 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dd4798a2-3d26-4465-8b2d-d4c494e95c2f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:29.991043 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dd4798a2-3d26-4465-8b2d-d4c494e95c2f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:30.013874 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.objects.instance [None req-dd4798a2-3d26-4465-8b2d-d4c494e95c2f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lazy-loading 'flavor' on Instance uuid 08ba9691-685f-444a-9c86-9ac1562acbf0 {{(pid=133015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:41:30.437947 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-dd4798a2-3d26-4465-8b2d-d4c494e95c2f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "POST /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0/action" status: 200 len: 32 microversion: 2.1 time: 0.484171 Aug 24 13:41:30.439289 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 188/372] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 13:41:29 2022] POST /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0/action => generated 32 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 13:41:30.450836 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e3d55f21-290a-4576-9455-f50cce55e2df tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:30.451891 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-e3d55f21-290a-4576-9455-f50cce55e2df tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:30.459399 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e3d55f21-290a-4576-9455-f50cce55e2df tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:30.462254 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e3d55f21-290a-4576-9455-f50cce55e2df tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:30.462254 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e3d55f21-290a-4576-9455-f50cce55e2df tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:30.462254 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e3d55f21-290a-4576-9455-f50cce55e2df tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:30.462878 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e3d55f21-290a-4576-9455-f50cce55e2df tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:30.463557 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e3d55f21-290a-4576-9455-f50cce55e2df tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:31.002464 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-5e4b4ce6-7aae-49b1-a059-7cb9703362b8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:31.007747 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-5e4b4ce6-7aae-49b1-a059-7cb9703362b8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:31.046207 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5e4b4ce6-7aae-49b1-a059-7cb9703362b8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:31.050224 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5e4b4ce6-7aae-49b1-a059-7cb9703362b8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:31.052818 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5e4b4ce6-7aae-49b1-a059-7cb9703362b8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:31.060390 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5e4b4ce6-7aae-49b1-a059-7cb9703362b8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:31.061293 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5e4b4ce6-7aae-49b1-a059-7cb9703362b8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:31.062227 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5e4b4ce6-7aae-49b1-a059-7cb9703362b8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:31.147115 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:41:31.163880 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e3d55f21-290a-4576-9455-f50cce55e2df tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:31.186431 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-e3d55f21-290a-4576-9455-f50cce55e2df tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.741406 Aug 24 13:41:31.187699 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 185/373] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:30 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:31.539214 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-5e4b4ce6-7aae-49b1-a059-7cb9703362b8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:31.551346 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-5e4b4ce6-7aae-49b1-a059-7cb9703362b8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:31.552960 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-5e4b4ce6-7aae-49b1-a059-7cb9703362b8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:31.554461 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-5e4b4ce6-7aae-49b1-a059-7cb9703362b8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.564973 Aug 24 13:41:31.570319 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 189/374] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:30 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:32.211069 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-c1541f01-3458-49d6-a82d-dac3107f2e13 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:32.211798 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-c1541f01-3458-49d6-a82d-dac3107f2e13 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:32.219982 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c1541f01-3458-49d6-a82d-dac3107f2e13 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:32.220518 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c1541f01-3458-49d6-a82d-dac3107f2e13 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:32.220950 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c1541f01-3458-49d6-a82d-dac3107f2e13 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:32.221643 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c1541f01-3458-49d6-a82d-dac3107f2e13 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:32.222207 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c1541f01-3458-49d6-a82d-dac3107f2e13 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:32.222629 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c1541f01-3458-49d6-a82d-dac3107f2e13 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:32.375886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-c1541f01-3458-49d6-a82d-dac3107f2e13 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:32.390607 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-c1541f01-3458-49d6-a82d-dac3107f2e13 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.183286 Aug 24 13:41:32.391529 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 186/375] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:32 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:32.577895 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-3e316b62-0301-4213-8967-e6eca1979323 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:32.578516 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-3e316b62-0301-4213-8967-e6eca1979323 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:32.584937 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3e316b62-0301-4213-8967-e6eca1979323 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:32.585432 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3e316b62-0301-4213-8967-e6eca1979323 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:32.585873 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3e316b62-0301-4213-8967-e6eca1979323 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:32.586576 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3e316b62-0301-4213-8967-e6eca1979323 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:32.590544 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3e316b62-0301-4213-8967-e6eca1979323 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:32.590544 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3e316b62-0301-4213-8967-e6eca1979323 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:32.798387 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-3e316b62-0301-4213-8967-e6eca1979323 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:32.809315 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-3e316b62-0301-4213-8967-e6eca1979323 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:32.818656 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-3e316b62-0301-4213-8967-e6eca1979323 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:32.818656 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-3e316b62-0301-4213-8967-e6eca1979323 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.240100 Aug 24 13:41:32.818656 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 190/376] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:32 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:41:33.416829 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-d1e75e31-3b92-4d9c-8c18-5fe90681d461 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:33.421350 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-d1e75e31-3b92-4d9c-8c18-5fe90681d461 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:33.433176 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d1e75e31-3b92-4d9c-8c18-5fe90681d461 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:33.434776 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d1e75e31-3b92-4d9c-8c18-5fe90681d461 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:33.435844 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d1e75e31-3b92-4d9c-8c18-5fe90681d461 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:33.442710 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d1e75e31-3b92-4d9c-8c18-5fe90681d461 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:33.443863 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d1e75e31-3b92-4d9c-8c18-5fe90681d461 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:33.444753 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d1e75e31-3b92-4d9c-8c18-5fe90681d461 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:33.848239 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-f74c987c-3f48-4405-a54b-778a65a7c47a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:33.848939 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-f74c987c-3f48-4405-a54b-778a65a7c47a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:33.891759 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f74c987c-3f48-4405-a54b-778a65a7c47a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:33.892826 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f74c987c-3f48-4405-a54b-778a65a7c47a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:33.893530 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f74c987c-3f48-4405-a54b-778a65a7c47a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:33.894686 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f74c987c-3f48-4405-a54b-778a65a7c47a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:33.895417 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f74c987c-3f48-4405-a54b-778a65a7c47a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:33.896433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f74c987c-3f48-4405-a54b-778a65a7c47a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:34.042591 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-d1e75e31-3b92-4d9c-8c18-5fe90681d461 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:34.063919 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-d1e75e31-3b92-4d9c-8c18-5fe90681d461 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.653714 Aug 24 13:41:34.065483 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 187/377] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:33 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:34.246754 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f74c987c-3f48-4405-a54b-778a65a7c47a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:34.258610 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f74c987c-3f48-4405-a54b-778a65a7c47a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:34.260557 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f74c987c-3f48-4405-a54b-778a65a7c47a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:34.261983 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-f74c987c-3f48-4405-a54b-778a65a7c47a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.418089 Aug 24 13:41:34.262887 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 191/378] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:33 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:35.093781 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-96204261-3c4d-42cb-a4da-35759df29c27 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:35.097679 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-96204261-3c4d-42cb-a4da-35759df29c27 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:35.102234 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-96204261-3c4d-42cb-a4da-35759df29c27 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:35.102977 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-96204261-3c4d-42cb-a4da-35759df29c27 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:35.103501 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-96204261-3c4d-42cb-a4da-35759df29c27 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:35.104405 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-96204261-3c4d-42cb-a4da-35759df29c27 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:35.105215 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-96204261-3c4d-42cb-a4da-35759df29c27 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:35.105465 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-96204261-3c4d-42cb-a4da-35759df29c27 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:35.296004 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-96204261-3c4d-42cb-a4da-35759df29c27 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:35.307917 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-96204261-3c4d-42cb-a4da-35759df29c27 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.219065 Aug 24 13:41:35.309427 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 188/379] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:35 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:35.317079 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-335f33bb-41d3-49be-9dff-3a1c53b8e3a2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:35.317951 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-335f33bb-41d3-49be-9dff-3a1c53b8e3a2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:35.331299 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-335f33bb-41d3-49be-9dff-3a1c53b8e3a2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:35.331813 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-335f33bb-41d3-49be-9dff-3a1c53b8e3a2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:35.338584 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-335f33bb-41d3-49be-9dff-3a1c53b8e3a2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:35.340715 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-335f33bb-41d3-49be-9dff-3a1c53b8e3a2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:35.341840 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-335f33bb-41d3-49be-9dff-3a1c53b8e3a2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:35.342758 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-335f33bb-41d3-49be-9dff-3a1c53b8e3a2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:35.565024 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-335f33bb-41d3-49be-9dff-3a1c53b8e3a2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:35.580040 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-335f33bb-41d3-49be-9dff-3a1c53b8e3a2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:35.583186 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-335f33bb-41d3-49be-9dff-3a1c53b8e3a2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:35.585427 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-335f33bb-41d3-49be-9dff-3a1c53b8e3a2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.292537 Aug 24 13:41:35.586434 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 192/380] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:35 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:36.331232 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-3cdfb049-4053-478d-81ed-667d5159e217 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:36.331926 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-3cdfb049-4053-478d-81ed-667d5159e217 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:36.338122 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3cdfb049-4053-478d-81ed-667d5159e217 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:36.338732 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3cdfb049-4053-478d-81ed-667d5159e217 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:36.339168 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3cdfb049-4053-478d-81ed-667d5159e217 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:36.341035 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3cdfb049-4053-478d-81ed-667d5159e217 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:36.341594 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3cdfb049-4053-478d-81ed-667d5159e217 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:36.342078 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3cdfb049-4053-478d-81ed-667d5159e217 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:36.517980 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3cdfb049-4053-478d-81ed-667d5159e217 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:36.527654 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-3cdfb049-4053-478d-81ed-667d5159e217 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.200036 Aug 24 13:41:36.532237 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 189/381] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:36 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:36.611847 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-2f9075a9-0516-455c-b8db-8db08ef53a6c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:36.612452 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-2f9075a9-0516-455c-b8db-8db08ef53a6c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:36.619124 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f9075a9-0516-455c-b8db-8db08ef53a6c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:36.619928 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f9075a9-0516-455c-b8db-8db08ef53a6c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:36.620382 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f9075a9-0516-455c-b8db-8db08ef53a6c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:36.621770 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f9075a9-0516-455c-b8db-8db08ef53a6c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:36.622414 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f9075a9-0516-455c-b8db-8db08ef53a6c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:36.622835 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f9075a9-0516-455c-b8db-8db08ef53a6c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:36.802603 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2f9075a9-0516-455c-b8db-8db08ef53a6c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:36.825511 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2f9075a9-0516-455c-b8db-8db08ef53a6c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:36.830024 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2f9075a9-0516-455c-b8db-8db08ef53a6c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:36.832508 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-2f9075a9-0516-455c-b8db-8db08ef53a6c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.223723 Aug 24 13:41:36.834385 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 193/382] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:36 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:37.578459 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-31b8a75f-f62b-45ad-a524-76375f2ea164 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:37.578459 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-31b8a75f-f62b-45ad-a524-76375f2ea164 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:37.592402 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-31b8a75f-f62b-45ad-a524-76375f2ea164 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:37.593252 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-31b8a75f-f62b-45ad-a524-76375f2ea164 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:37.593929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-31b8a75f-f62b-45ad-a524-76375f2ea164 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:37.595066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-31b8a75f-f62b-45ad-a524-76375f2ea164 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:37.596112 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-31b8a75f-f62b-45ad-a524-76375f2ea164 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:37.596939 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-31b8a75f-f62b-45ad-a524-76375f2ea164 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:37.807974 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-31b8a75f-f62b-45ad-a524-76375f2ea164 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:37.829128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-31b8a75f-f62b-45ad-a524-76375f2ea164 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.275250 Aug 24 13:41:37.829966 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 190/383] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:37 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:37.868239 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-f4aeb76a-532d-4272-8ad3-07dadcec7743 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:37.869440 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-f4aeb76a-532d-4272-8ad3-07dadcec7743 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:37.891104 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f4aeb76a-532d-4272-8ad3-07dadcec7743 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:37.891104 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f4aeb76a-532d-4272-8ad3-07dadcec7743 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:37.891104 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f4aeb76a-532d-4272-8ad3-07dadcec7743 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:37.891104 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f4aeb76a-532d-4272-8ad3-07dadcec7743 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:37.891550 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f4aeb76a-532d-4272-8ad3-07dadcec7743 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:37.891550 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f4aeb76a-532d-4272-8ad3-07dadcec7743 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:38.057143 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f4aeb76a-532d-4272-8ad3-07dadcec7743 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:38.068713 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f4aeb76a-532d-4272-8ad3-07dadcec7743 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:38.070585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f4aeb76a-532d-4272-8ad3-07dadcec7743 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:38.072013 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-f4aeb76a-532d-4272-8ad3-07dadcec7743 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.212428 Aug 24 13:41:38.073296 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 194/384] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:37 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:38.854967 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-fd9ad530-0042-4b3d-a4f1-4b51b96a72db tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:38.857224 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-fd9ad530-0042-4b3d-a4f1-4b51b96a72db tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:38.869629 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fd9ad530-0042-4b3d-a4f1-4b51b96a72db tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:38.882931 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fd9ad530-0042-4b3d-a4f1-4b51b96a72db tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:38.882931 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fd9ad530-0042-4b3d-a4f1-4b51b96a72db tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:38.882931 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fd9ad530-0042-4b3d-a4f1-4b51b96a72db tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:38.882931 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fd9ad530-0042-4b3d-a4f1-4b51b96a72db tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:38.884388 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fd9ad530-0042-4b3d-a4f1-4b51b96a72db tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:39.097376 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-fd9ad530-0042-4b3d-a4f1-4b51b96a72db tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:39.101483 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d0a61cfe-aa6f-438e-b39f-33c6ccd6dfe5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:39.102102 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-d0a61cfe-aa6f-438e-b39f-33c6ccd6dfe5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:39.115323 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d0a61cfe-aa6f-438e-b39f-33c6ccd6dfe5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:39.117970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d0a61cfe-aa6f-438e-b39f-33c6ccd6dfe5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:39.117970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d0a61cfe-aa6f-438e-b39f-33c6ccd6dfe5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:39.117970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d0a61cfe-aa6f-438e-b39f-33c6ccd6dfe5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:39.117970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d0a61cfe-aa6f-438e-b39f-33c6ccd6dfe5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:39.118408 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d0a61cfe-aa6f-438e-b39f-33c6ccd6dfe5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:39.118792 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-fd9ad530-0042-4b3d-a4f1-4b51b96a72db tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.271250 Aug 24 13:41:39.119568 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 191/385] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:38 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:39.298443 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d0a61cfe-aa6f-438e-b39f-33c6ccd6dfe5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:39.308062 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d0a61cfe-aa6f-438e-b39f-33c6ccd6dfe5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:39.310803 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d0a61cfe-aa6f-438e-b39f-33c6ccd6dfe5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:39.312282 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-d0a61cfe-aa6f-438e-b39f-33c6ccd6dfe5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.218367 Aug 24 13:41:39.312979 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 195/386] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:39 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:40.140166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-87775835-209b-4984-80e3-758ed023c968 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:40.141859 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-87775835-209b-4984-80e3-758ed023c968 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:40.148399 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-87775835-209b-4984-80e3-758ed023c968 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:40.149187 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-87775835-209b-4984-80e3-758ed023c968 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:40.149814 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-87775835-209b-4984-80e3-758ed023c968 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:40.150529 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-87775835-209b-4984-80e3-758ed023c968 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:40.150982 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-87775835-209b-4984-80e3-758ed023c968 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:40.151618 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-87775835-209b-4984-80e3-758ed023c968 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:40.337549 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-87775835-209b-4984-80e3-758ed023c968 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:40.345012 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-95432782-bebf-4934-8e07-1bbb220911ce tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:40.346718 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-95432782-bebf-4934-8e07-1bbb220911ce tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:40.356294 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-87775835-209b-4984-80e3-758ed023c968 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.216388 Aug 24 13:41:40.357865 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 192/387] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:40 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:40.377500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-95432782-bebf-4934-8e07-1bbb220911ce tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:40.378263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-95432782-bebf-4934-8e07-1bbb220911ce tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:40.378854 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-95432782-bebf-4934-8e07-1bbb220911ce tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:40.383091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-95432782-bebf-4934-8e07-1bbb220911ce tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:40.383608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-95432782-bebf-4934-8e07-1bbb220911ce tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:40.384053 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-95432782-bebf-4934-8e07-1bbb220911ce tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:40.556727 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-95432782-bebf-4934-8e07-1bbb220911ce tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:40.568338 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-95432782-bebf-4934-8e07-1bbb220911ce tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:40.569944 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-95432782-bebf-4934-8e07-1bbb220911ce tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:40.571269 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-95432782-bebf-4934-8e07-1bbb220911ce tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.231653 Aug 24 13:41:40.571846 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 196/388] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:40 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:41.380524 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-4ed3e11b-02fd-47e9-bfe2-e01d46032cd9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:41.381311 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-4ed3e11b-02fd-47e9-bfe2-e01d46032cd9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:41.390896 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4ed3e11b-02fd-47e9-bfe2-e01d46032cd9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:41.391552 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4ed3e11b-02fd-47e9-bfe2-e01d46032cd9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:41.392070 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4ed3e11b-02fd-47e9-bfe2-e01d46032cd9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:41.393008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4ed3e11b-02fd-47e9-bfe2-e01d46032cd9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:41.398744 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4ed3e11b-02fd-47e9-bfe2-e01d46032cd9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:41.399756 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4ed3e11b-02fd-47e9-bfe2-e01d46032cd9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:41.605599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-2da68a88-4444-4d7c-b15a-615d9ef803b7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:41.608220 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-2da68a88-4444-4d7c-b15a-615d9ef803b7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:41.615031 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2da68a88-4444-4d7c-b15a-615d9ef803b7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:41.615786 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2da68a88-4444-4d7c-b15a-615d9ef803b7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:41.616425 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2da68a88-4444-4d7c-b15a-615d9ef803b7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:41.617339 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2da68a88-4444-4d7c-b15a-615d9ef803b7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:41.618102 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2da68a88-4444-4d7c-b15a-615d9ef803b7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:41.618759 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2da68a88-4444-4d7c-b15a-615d9ef803b7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:41.631949 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-4ed3e11b-02fd-47e9-bfe2-e01d46032cd9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:41.643480 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-4ed3e11b-02fd-47e9-bfe2-e01d46032cd9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.268008 Aug 24 13:41:41.645008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 193/389] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:41 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:41.794933 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2da68a88-4444-4d7c-b15a-615d9ef803b7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:41.820308 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2da68a88-4444-4d7c-b15a-615d9ef803b7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:41.830889 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2da68a88-4444-4d7c-b15a-615d9ef803b7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:41.832204 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-2da68a88-4444-4d7c-b15a-615d9ef803b7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.232246 Aug 24 13:41:41.844210 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 197/390] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:41 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:42.674493 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-dbc65efe-45f6-456e-ac5b-fd7e8a5e0b3f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:42.674493 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-dbc65efe-45f6-456e-ac5b-fd7e8a5e0b3f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:42.674493 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dbc65efe-45f6-456e-ac5b-fd7e8a5e0b3f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:42.674493 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dbc65efe-45f6-456e-ac5b-fd7e8a5e0b3f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:42.675455 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dbc65efe-45f6-456e-ac5b-fd7e8a5e0b3f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:42.675455 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dbc65efe-45f6-456e-ac5b-fd7e8a5e0b3f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:42.675938 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dbc65efe-45f6-456e-ac5b-fd7e8a5e0b3f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:42.676393 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dbc65efe-45f6-456e-ac5b-fd7e8a5e0b3f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:42.820747 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-dbc65efe-45f6-456e-ac5b-fd7e8a5e0b3f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:42.829288 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-dbc65efe-45f6-456e-ac5b-fd7e8a5e0b3f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.167398 Aug 24 13:41:42.829859 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 194/391] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:42 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:42.860027 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-af623049-7f88-46a1-b695-5f2c9aabdf1f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:42.860706 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-af623049-7f88-46a1-b695-5f2c9aabdf1f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:42.868349 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-af623049-7f88-46a1-b695-5f2c9aabdf1f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:42.868921 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-af623049-7f88-46a1-b695-5f2c9aabdf1f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:42.869358 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-af623049-7f88-46a1-b695-5f2c9aabdf1f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:42.870047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-af623049-7f88-46a1-b695-5f2c9aabdf1f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:42.872127 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-af623049-7f88-46a1-b695-5f2c9aabdf1f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:42.872127 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-af623049-7f88-46a1-b695-5f2c9aabdf1f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:43.052810 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-af623049-7f88-46a1-b695-5f2c9aabdf1f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:43.064465 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-af623049-7f88-46a1-b695-5f2c9aabdf1f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:43.067052 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-af623049-7f88-46a1-b695-5f2c9aabdf1f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:43.069116 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-af623049-7f88-46a1-b695-5f2c9aabdf1f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.212870 Aug 24 13:41:43.070416 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 198/392] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:42 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:41:43.102775 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-fbf81beb-5174-454a-86ad-90034fe091ef tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:43.110549 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-fbf81beb-5174-454a-86ad-90034fe091ef tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:43.111001 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fbf81beb-5174-454a-86ad-90034fe091ef tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:43.111934 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fbf81beb-5174-454a-86ad-90034fe091ef tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:43.112519 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fbf81beb-5174-454a-86ad-90034fe091ef tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:43.113592 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fbf81beb-5174-454a-86ad-90034fe091ef tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:43.114282 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fbf81beb-5174-454a-86ad-90034fe091ef tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:43.114717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fbf81beb-5174-454a-86ad-90034fe091ef tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:43.142930 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-fbf81beb-5174-454a-86ad-90034fe091ef tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6/ips" status: 200 len: 150 microversion: 2.1 time: 0.059901 Aug 24 13:41:43.143510 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 195/393] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 13:41:43 2022] GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6/ips => generated 150 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:41:43.157259 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-50084c30-80be-4b77-b8e3-91948ce3f47e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f4377f2-a0f1-4473-af0f-7b4b14e0661b"}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:41:43.159704 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-50084c30-80be-4b77-b8e3-91948ce3f47e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:43.165826 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-50084c30-80be-4b77-b8e3-91948ce3f47e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:43.166311 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-50084c30-80be-4b77-b8e3-91948ce3f47e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:43.166749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-50084c30-80be-4b77-b8e3-91948ce3f47e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:43.167486 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-50084c30-80be-4b77-b8e3-91948ce3f47e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:43.168517 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-50084c30-80be-4b77-b8e3-91948ce3f47e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:43.169018 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-50084c30-80be-4b77-b8e3-91948ce3f47e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:43.256967 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.wsgi [None req-50084c30-80be-4b77-b8e3-91948ce3f47e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] HTTP exception thrown: Invalid volume: volume 0f4377f2-a0f1-4473-af0f-7b4b14e0661b is already attached to instances: 3ad88e6d-b2b8-4049-b987-94022767fa67 Aug 24 13:41:43.258970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-50084c30-80be-4b77-b8e3-91948ce3f47e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Request method failure captured: Aug 24 13:41:43.258970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: POST /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6/os-volume_attachments HTTP/1.1 Aug 24 13:41:43.258970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:41:43.258970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:41:43.258970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:41:43.258970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 74 Aug 24 13:41:43.258970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:41:43.258970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:41:43.258970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:41:43.258970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:41:43.258970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBinWm1p0b_H31lzxpPvzbV7rjy3F8Qzyn9V8PX7wwFXRHJCaJ71LLFkZ_Lkt8k4m1f9ymfMSrmW4KTZotPqVtGf-HmA9MGnpTEXSHWlAWKAH6WNjAbNhI-4NP4nK3tGleZkG8cnaBgxLFes9pTCCxx0p3rv03UC4QT5l95RSPxVokdw Aug 24 13:41:43.258970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:41:43.258970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:41:43.258970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:41:43.258970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:41:43.258970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:41:43.258970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:41:43.258970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:41:43.258970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:41:43.258970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:41:43.258970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:41:43.262433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:41:43.262433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:41:43.262433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:41:43.262433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:41:43.262433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:41:43.262433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:41:43.262433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:41:43.262433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: ea9d4eafe59c4c8180eece8ec9283e40 Aug 24 13:41:43.262433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:41:43.262433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Aug 24 13:41:43.262433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {"volumeAttachment": {"volumeId": "0f4377f2-a0f1-4473-af0f-7b4b14e0661b"}} Aug 24 13:41:43.262433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: > Aug 24 13:41:43.264263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Invalid volume: volume 0f4377f2-a0f1-4473-af0f-7b4b14e0661b is already attached to instances: 3ad88e6d-b2b8-4049-b987-94022767fa67 Aug 24 13:41:43.264263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'server_id': '807615f2-1905-4a84-8a8b-574886415dc6', 'body': {'volumeAttachment': {'volumeId': '0f4377f2-a0f1-4473-af0f-7b4b14e0661b'}}} Aug 24 13:41:43.264263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:41:43.264263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:41:43.264263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 13:41:43.264263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 13:41:43.264263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 13:41:43.264263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 13:41:43.264263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 13:41:43.264263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 13:41:43.264263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 13:41:43.264263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 13:41:43.264263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 13:41:43.264263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 13:41:43.264263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0f4377f2-a0f1-4473-af0f-7b4b14e0661b is already attached to instances: 3ad88e6d-b2b8-4049-b987-94022767fa67 Aug 24 13:41:43.264263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:41:43.264263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:41:43.264263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:41:43.264263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:41:43.267021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:41:43.267021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:41:43.267021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:41:43.267021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:41:43.267021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:41:43.267021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:41:43.267021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 13:41:43.267021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 13:41:43.267021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 13:41:43.267021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 13:41:43.267021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 13:41:43.267021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 13:41:43.267021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 13:41:43.267021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 13:41:43.267021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0f4377f2-a0f1-4473-af0f-7b4b14e0661b is already attached to instances: 3ad88e6d-b2b8-4049-b987-94022767fa67 Aug 24 13:41:43.267021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:41:43.267021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:41:43.267021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:41:43.267021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:41:43.267021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:41:43.271017 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:41:43.271017 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:41:43.271017 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:41:43.271017 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0f4377f2-a0f1-4473-af0f-7b4b14e0661b is already attached to instances: 3ad88e6d-b2b8-4049-b987-94022767fa67 Aug 24 13:41:43.271017 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:41:43.271017 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-50084c30-80be-4b77-b8e3-91948ce3f47e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Returning 400 to user: Invalid volume: volume 0f4377f2-a0f1-4473-af0f-7b4b14e0661b is already attached to instances: 3ad88e6d-b2b8-4049-b987-94022767fa67 {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:41:43.271017 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-50084c30-80be-4b77-b8e3-91948ce3f47e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "POST /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107362 Aug 24 13:41:43.271017 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 199/394] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 13:41:43 2022] POST /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 13:41:43.272390 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-85c9a81e-6ff5-4c23-8a09-16086fb92848 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:43.272390 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-85c9a81e-6ff5-4c23-8a09-16086fb92848 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:43.278626 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-85c9a81e-6ff5-4c23-8a09-16086fb92848 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:43.278915 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-85c9a81e-6ff5-4c23-8a09-16086fb92848 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:43.279496 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-85c9a81e-6ff5-4c23-8a09-16086fb92848 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:43.280223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-85c9a81e-6ff5-4c23-8a09-16086fb92848 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:43.280994 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-85c9a81e-6ff5-4c23-8a09-16086fb92848 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:43.280994 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-85c9a81e-6ff5-4c23-8a09-16086fb92848 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:43.317120 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-85c9a81e-6ff5-4c23-8a09-16086fb92848 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Going to try to terminate instance {{(pid=133014) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 13:41:43.336406 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=100 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:41:43.724050 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-85c9a81e-6ff5-4c23-8a09-16086fb92848 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "DELETE /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6" status: 204 len: 0 microversion: 2.1 time: 0.456869 Aug 24 13:41:43.725511 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 196/395] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:41:43 2022] DELETE /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 13:41:43.734346 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-ab898180-8bdd-4796-9289-9b81d0882798 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:43.735084 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-ab898180-8bdd-4796-9289-9b81d0882798 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:43.737284 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:41:43.745060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ab898180-8bdd-4796-9289-9b81d0882798 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:43.746507 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ab898180-8bdd-4796-9289-9b81d0882798 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:43.747120 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ab898180-8bdd-4796-9289-9b81d0882798 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:43.747889 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ab898180-8bdd-4796-9289-9b81d0882798 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:43.748466 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ab898180-8bdd-4796-9289-9b81d0882798 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:43.748982 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ab898180-8bdd-4796-9289-9b81d0882798 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:43.855523 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-26493377-3c8a-435f-953f-dac463ab7b51 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:43.865197 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-26493377-3c8a-435f-953f-dac463ab7b51 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:43.881558 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-26493377-3c8a-435f-953f-dac463ab7b51 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:43.883014 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-26493377-3c8a-435f-953f-dac463ab7b51 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:44.013604 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-26493377-3c8a-435f-953f-dac463ab7b51 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:44.013604 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-26493377-3c8a-435f-953f-dac463ab7b51 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:44.013604 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-26493377-3c8a-435f-953f-dac463ab7b51 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:44.013604 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-26493377-3c8a-435f-953f-dac463ab7b51 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:44.015864 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-ab898180-8bdd-4796-9289-9b81d0882798 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:44.015864 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-ab898180-8bdd-4796-9289-9b81d0882798 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6" status: 200 len: 1682 microversion: 2.1 time: 0.249651 Aug 24 13:41:44.015864 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 200/396] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:43 2022] GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 => generated 1682 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:44.110827 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-79cb773a-b02f-436e-aa82-efdf04cc4789 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:44.113107 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-79cb773a-b02f-436e-aa82-efdf04cc4789 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:44.120079 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-79cb773a-b02f-436e-aa82-efdf04cc4789 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:44.122614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-79cb773a-b02f-436e-aa82-efdf04cc4789 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:44.123369 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-79cb773a-b02f-436e-aa82-efdf04cc4789 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:44.124453 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-79cb773a-b02f-436e-aa82-efdf04cc4789 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:44.125080 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-79cb773a-b02f-436e-aa82-efdf04cc4789 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:44.125674 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-79cb773a-b02f-436e-aa82-efdf04cc4789 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:44.130155 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-26493377-3c8a-435f-953f-dac463ab7b51 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:44.143556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-26493377-3c8a-435f-953f-dac463ab7b51 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.295686 Aug 24 13:41:44.144846 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 197/397] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:43 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:44.281866 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-79cb773a-b02f-436e-aa82-efdf04cc4789 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:44.291056 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-79cb773a-b02f-436e-aa82-efdf04cc4789 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:44.292611 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-79cb773a-b02f-436e-aa82-efdf04cc4789 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:44.294170 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-79cb773a-b02f-436e-aa82-efdf04cc4789 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.187923 Aug 24 13:41:44.294757 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 201/398] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:44 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:41:45.042768 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-6a2b0b64-5884-42c8-ab2d-386f7efee23c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:45.043460 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-6a2b0b64-5884-42c8-ab2d-386f7efee23c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:45.050146 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6a2b0b64-5884-42c8-ab2d-386f7efee23c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:45.050645 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6a2b0b64-5884-42c8-ab2d-386f7efee23c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:45.051100 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6a2b0b64-5884-42c8-ab2d-386f7efee23c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:45.051804 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6a2b0b64-5884-42c8-ab2d-386f7efee23c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:45.052299 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6a2b0b64-5884-42c8-ab2d-386f7efee23c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:45.052727 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6a2b0b64-5884-42c8-ab2d-386f7efee23c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:45.172605 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-6f83177d-d783-4478-b470-7f86b6022230 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:45.174136 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-6f83177d-d783-4478-b470-7f86b6022230 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:45.181653 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f83177d-d783-4478-b470-7f86b6022230 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:45.182145 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f83177d-d783-4478-b470-7f86b6022230 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:45.182584 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f83177d-d783-4478-b470-7f86b6022230 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:45.184316 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f83177d-d783-4478-b470-7f86b6022230 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:45.184787 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f83177d-d783-4478-b470-7f86b6022230 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:45.185213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f83177d-d783-4478-b470-7f86b6022230 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:45.212124 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-6a2b0b64-5884-42c8-ab2d-386f7efee23c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:45.221680 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-6a2b0b64-5884-42c8-ab2d-386f7efee23c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6" status: 200 len: 1682 microversion: 2.1 time: 0.182778 Aug 24 13:41:45.222267 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 198/399] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:45 2022] GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:45.323024 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-3856005a-624d-4656-8353-8c5876b4f355 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:45.327705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-3856005a-624d-4656-8353-8c5876b4f355 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:45.339411 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3856005a-624d-4656-8353-8c5876b4f355 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:45.340724 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3856005a-624d-4656-8353-8c5876b4f355 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:45.341745 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3856005a-624d-4656-8353-8c5876b4f355 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:45.343237 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3856005a-624d-4656-8353-8c5876b4f355 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:45.344034 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3856005a-624d-4656-8353-8c5876b4f355 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:45.345032 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3856005a-624d-4656-8353-8c5876b4f355 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:45.381855 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-6f83177d-d783-4478-b470-7f86b6022230 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:45.391194 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-6f83177d-d783-4478-b470-7f86b6022230 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.227363 Aug 24 13:41:45.396654 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 202/400] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:45 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:45.556698 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3856005a-624d-4656-8353-8c5876b4f355 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:45.569204 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3856005a-624d-4656-8353-8c5876b4f355 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:45.572639 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3856005a-624d-4656-8353-8c5876b4f355 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:45.572872 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-3856005a-624d-4656-8353-8c5876b4f355 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.253959 Aug 24 13:41:45.574428 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 199/401] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:45 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:46.248877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-24be61c1-98cc-46f6-8f3d-85c26952ce00 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:46.249750 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-24be61c1-98cc-46f6-8f3d-85c26952ce00 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:46.259019 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-24be61c1-98cc-46f6-8f3d-85c26952ce00 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:46.259742 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-24be61c1-98cc-46f6-8f3d-85c26952ce00 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:46.260363 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-24be61c1-98cc-46f6-8f3d-85c26952ce00 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:46.261878 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-24be61c1-98cc-46f6-8f3d-85c26952ce00 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:46.262877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-24be61c1-98cc-46f6-8f3d-85c26952ce00 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:46.263347 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-24be61c1-98cc-46f6-8f3d-85c26952ce00 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:46.415947 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-3e782938-a17d-42c7-aa18-9357f4974dad tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:46.415947 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-3e782938-a17d-42c7-aa18-9357f4974dad tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:46.425775 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3e782938-a17d-42c7-aa18-9357f4974dad tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:46.425775 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3e782938-a17d-42c7-aa18-9357f4974dad tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:46.425775 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3e782938-a17d-42c7-aa18-9357f4974dad tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:46.425775 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3e782938-a17d-42c7-aa18-9357f4974dad tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:46.426882 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3e782938-a17d-42c7-aa18-9357f4974dad tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:46.427532 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3e782938-a17d-42c7-aa18-9357f4974dad tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:46.607985 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-24be61c1-98cc-46f6-8f3d-85c26952ce00 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:46.616737 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-24be61c1-98cc-46f6-8f3d-85c26952ce00 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6" status: 200 len: 1682 microversion: 2.1 time: 0.374243 Aug 24 13:41:46.617932 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 203/402] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:46 2022] GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 => generated 1682 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:46.622622 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-27b38f87-7959-49b6-80d3-d406377d8e6a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:46.623289 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-27b38f87-7959-49b6-80d3-d406377d8e6a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:46.629645 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-27b38f87-7959-49b6-80d3-d406377d8e6a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:46.630134 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-27b38f87-7959-49b6-80d3-d406377d8e6a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:46.630568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-27b38f87-7959-49b6-80d3-d406377d8e6a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:46.631271 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-27b38f87-7959-49b6-80d3-d406377d8e6a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:46.631756 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-27b38f87-7959-49b6-80d3-d406377d8e6a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:46.632337 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-27b38f87-7959-49b6-80d3-d406377d8e6a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:46.793559 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3e782938-a17d-42c7-aa18-9357f4974dad tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:46.806023 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-3e782938-a17d-42c7-aa18-9357f4974dad tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.396507 Aug 24 13:41:46.807439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 200/403] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:46 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:41:46.993916 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-27b38f87-7959-49b6-80d3-d406377d8e6a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:47.017015 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-27b38f87-7959-49b6-80d3-d406377d8e6a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:47.021920 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-27b38f87-7959-49b6-80d3-d406377d8e6a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:47.024162 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-27b38f87-7959-49b6-80d3-d406377d8e6a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.405498 Aug 24 13:41:47.025905 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 204/404] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:46 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:47.640581 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e5161a5c-05cd-4521-aa89-7daf052e1c9b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:47.641613 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-e5161a5c-05cd-4521-aa89-7daf052e1c9b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:47.648791 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e5161a5c-05cd-4521-aa89-7daf052e1c9b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:47.649300 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e5161a5c-05cd-4521-aa89-7daf052e1c9b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:47.649739 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e5161a5c-05cd-4521-aa89-7daf052e1c9b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:47.650707 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e5161a5c-05cd-4521-aa89-7daf052e1c9b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:47.651211 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e5161a5c-05cd-4521-aa89-7daf052e1c9b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:47.651756 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e5161a5c-05cd-4521-aa89-7daf052e1c9b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:47.778640 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e5161a5c-05cd-4521-aa89-7daf052e1c9b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:47.784525 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-e5161a5c-05cd-4521-aa89-7daf052e1c9b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6" status: 200 len: 1615 microversion: 2.1 time: 0.149208 Aug 24 13:41:47.786040 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 201/405] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:47 2022] GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 => generated 1615 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:47.835477 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-fffbab08-2ed8-4ed1-a300-a0fc2d3f8ddf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:47.838032 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-fffbab08-2ed8-4ed1-a300-a0fc2d3f8ddf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:47.851469 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fffbab08-2ed8-4ed1-a300-a0fc2d3f8ddf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:47.853394 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fffbab08-2ed8-4ed1-a300-a0fc2d3f8ddf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:47.854144 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fffbab08-2ed8-4ed1-a300-a0fc2d3f8ddf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:47.855768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fffbab08-2ed8-4ed1-a300-a0fc2d3f8ddf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:47.856353 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fffbab08-2ed8-4ed1-a300-a0fc2d3f8ddf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:47.857384 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fffbab08-2ed8-4ed1-a300-a0fc2d3f8ddf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:48.061694 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a84c739b-f966-435b-b09c-0536a302fdf1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:48.065597 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a84c739b-f966-435b-b09c-0536a302fdf1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:48.069082 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:41:48.086916 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a84c739b-f966-435b-b09c-0536a302fdf1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:48.087514 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a84c739b-f966-435b-b09c-0536a302fdf1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:48.088035 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a84c739b-f966-435b-b09c-0536a302fdf1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:48.088969 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a84c739b-f966-435b-b09c-0536a302fdf1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:48.091062 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a84c739b-f966-435b-b09c-0536a302fdf1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:48.091585 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a84c739b-f966-435b-b09c-0536a302fdf1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:48.133062 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-fffbab08-2ed8-4ed1-a300-a0fc2d3f8ddf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:48.147140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-fffbab08-2ed8-4ed1-a300-a0fc2d3f8ddf tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.319672 Aug 24 13:41:48.148303 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 205/406] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:47 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:48.295914 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-886586da-ecbd-4a20-b2ce-05e71591263e req-8d69e1d2-3138-4ca3-953d-ced38adedc0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807615f2-1905-4a84-8a8b-574886415dc6", "name": "network-vif-deleted", "tag": "6904bc03-dddb-4f6f-a036-c88fbbe8434e"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:41:48.316163 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-886586da-ecbd-4a20-b2ce-05e71591263e req-8d69e1d2-3138-4ca3-953d-ced38adedc0b service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:48.317912 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-886586da-ecbd-4a20-b2ce-05e71591263e req-8d69e1d2-3138-4ca3-953d-ced38adedc0b service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:48.318897 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-886586da-ecbd-4a20-b2ce-05e71591263e req-8d69e1d2-3138-4ca3-953d-ced38adedc0b service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:48.329401 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=100 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:41:48.344085 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-886586da-ecbd-4a20-b2ce-05e71591263e req-8d69e1d2-3138-4ca3-953d-ced38adedc0b service nova] Creating event network-vif-deleted:6904bc03-dddb-4f6f-a036-c88fbbe8434e for instance 807615f2-1905-4a84-8a8b-574886415dc6 on hv-cinder-77957 Aug 24 13:41:48.345902 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a84c739b-f966-435b-b09c-0536a302fdf1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:48.355842 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-886586da-ecbd-4a20-b2ce-05e71591263e req-8d69e1d2-3138-4ca3-953d-ced38adedc0b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066494 Aug 24 13:41:48.356613 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a84c739b-f966-435b-b09c-0536a302fdf1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:48.357496 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 206/407] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:41:48.361412 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a84c739b-f966-435b-b09c-0536a302fdf1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:48.362849 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a84c739b-f966-435b-b09c-0536a302fdf1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.315136 Aug 24 13:41:48.363263 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 202/408] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:48 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:41:48.824290 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-99f08110-9ecb-4904-80f2-03b78e7930e7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:48.825230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-99f08110-9ecb-4904-80f2-03b78e7930e7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:48.849728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-99f08110-9ecb-4904-80f2-03b78e7930e7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:48.851543 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-99f08110-9ecb-4904-80f2-03b78e7930e7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:48.852015 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-99f08110-9ecb-4904-80f2-03b78e7930e7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:48.852778 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-99f08110-9ecb-4904-80f2-03b78e7930e7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:48.853244 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-99f08110-9ecb-4904-80f2-03b78e7930e7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:48.853913 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-99f08110-9ecb-4904-80f2-03b78e7930e7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:48.898632 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-99f08110-9ecb-4904-80f2-03b78e7930e7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:48.899232 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-99f08110-9ecb-4904-80f2-03b78e7930e7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:48.899679 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-99f08110-9ecb-4904-80f2-03b78e7930e7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:48.900111 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.objects.instance [None req-99f08110-9ecb-4904-80f2-03b78e7930e7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lazy-loading 'fault' on Instance uuid 807615f2-1905-4a84-8a8b-574886415dc6 {{(pid=133015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:41:48.949166 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-99f08110-9ecb-4904-80f2-03b78e7930e7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:48.956687 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-99f08110-9ecb-4904-80f2-03b78e7930e7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6" status: 200 len: 1332 microversion: 2.1 time: 0.137198 Aug 24 13:41:48.957889 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 207/409] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:48 2022] GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 => generated 1332 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:49.170870 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-bd8d474d-1b05-4f89-bcd2-5c785e79f539 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:49.172264 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-bd8d474d-1b05-4f89-bcd2-5c785e79f539 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:49.186062 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd8d474d-1b05-4f89-bcd2-5c785e79f539 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:49.186853 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd8d474d-1b05-4f89-bcd2-5c785e79f539 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:49.187968 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd8d474d-1b05-4f89-bcd2-5c785e79f539 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:49.190836 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd8d474d-1b05-4f89-bcd2-5c785e79f539 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:49.191482 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd8d474d-1b05-4f89-bcd2-5c785e79f539 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:49.192274 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd8d474d-1b05-4f89-bcd2-5c785e79f539 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:49.341139 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-bd8d474d-1b05-4f89-bcd2-5c785e79f539 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:49.353209 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-bd8d474d-1b05-4f89-bcd2-5c785e79f539 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.187150 Aug 24 13:41:49.353801 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 203/410] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:49 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:49.389455 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-bd2584f9-8df2-4154-83aa-d7f453cc5e4f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:49.390159 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-bd2584f9-8df2-4154-83aa-d7f453cc5e4f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:49.398782 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bd2584f9-8df2-4154-83aa-d7f453cc5e4f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:49.400162 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bd2584f9-8df2-4154-83aa-d7f453cc5e4f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:49.400739 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bd2584f9-8df2-4154-83aa-d7f453cc5e4f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:49.402768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bd2584f9-8df2-4154-83aa-d7f453cc5e4f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:49.403267 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bd2584f9-8df2-4154-83aa-d7f453cc5e4f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:49.404206 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bd2584f9-8df2-4154-83aa-d7f453cc5e4f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:49.645285 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-bd2584f9-8df2-4154-83aa-d7f453cc5e4f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:49.656583 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-bd2584f9-8df2-4154-83aa-d7f453cc5e4f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:49.658337 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-bd2584f9-8df2-4154-83aa-d7f453cc5e4f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:49.659872 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-bd2584f9-8df2-4154-83aa-d7f453cc5e4f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.278348 Aug 24 13:41:49.660961 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 208/411] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:49 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:41:49.985322 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-74485ed9-abdc-4e76-802e-0f179b53b20b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:49.989234 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-74485ed9-abdc-4e76-802e-0f179b53b20b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:49.998024 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-74485ed9-abdc-4e76-802e-0f179b53b20b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:49.998843 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-74485ed9-abdc-4e76-802e-0f179b53b20b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:50.000416 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-74485ed9-abdc-4e76-802e-0f179b53b20b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:50.000416 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-74485ed9-abdc-4e76-802e-0f179b53b20b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:50.000960 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-74485ed9-abdc-4e76-802e-0f179b53b20b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:50.001587 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-74485ed9-abdc-4e76-802e-0f179b53b20b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:50.019962 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-74485ed9-abdc-4e76-802e-0f179b53b20b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] HTTP exception thrown: Instance 807615f2-1905-4a84-8a8b-574886415dc6 could not be found. Aug 24 13:41:50.023375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-74485ed9-abdc-4e76-802e-0f179b53b20b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Request method failure captured: Aug 24 13:41:50.023375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 HTTP/1.1 Aug 24 13:41:50.023375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:41:50.023375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:41:50.023375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:41:50.023375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:41:50.023375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:41:50.023375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:41:50.023375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:41:50.023375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:41:50.023375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBinWm1p0b_H31lzxpPvzbV7rjy3F8Qzyn9V8PX7wwFXRHJCaJ71LLFkZ_Lkt8k4m1f9ymfMSrmW4KTZotPqVtGf-HmA9MGnpTEXSHWlAWKAH6WNjAbNhI-4NP4nK3tGleZkG8cnaBgxLFes9pTCCxx0p3rv03UC4QT5l95RSPxVokdw Aug 24 13:41:50.023375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:41:50.023375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:41:50.023375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:41:50.023375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:41:50.023375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:41:50.023375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:41:50.023375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:41:50.023375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:41:50.023375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:41:50.023375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:41:50.024870 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:41:50.024870 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:41:50.024870 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:41:50.024870 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:41:50.024870 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:41:50.024870 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:41:50.024870 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:41:50.024870 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: ea9d4eafe59c4c8180eece8ec9283e40 Aug 24 13:41:50.024870 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:41:50.024870 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:41:50.024870 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Instance 807615f2-1905-4a84-8a8b-574886415dc6 could not be found. Aug 24 13:41:50.024870 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': '807615f2-1905-4a84-8a8b-574886415dc6'} Aug 24 13:41:50.025667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:41:50.025667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:41:50.025667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:41:50.025667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:41:50.025667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:41:50.025667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:41:50.025667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:41:50.025667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:41:50.025667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:41:50.025667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:41:50.025667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 807615f2-1905-4a84-8a8b-574886415dc6 could not be found. Aug 24 13:41:50.025667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:41:50.025667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:41:50.025667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:41:50.025667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:41:50.025667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:41:50.025667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:41:50.025667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:41:50.025667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:41:50.025667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:41:50.028800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:41:50.028800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:41:50.028800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:41:50.028800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:41:50.028800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:41:50.028800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:41:50.028800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:41:50.028800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 807615f2-1905-4a84-8a8b-574886415dc6 could not be found. Aug 24 13:41:50.028800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:41:50.028800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:41:50.028800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:41:50.028800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:41:50.028800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:41:50.028800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:41:50.028800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:41:50.028800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:41:50.028800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 807615f2-1905-4a84-8a8b-574886415dc6 could not be found. Aug 24 13:41:50.028800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:41:50.032153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-74485ed9-abdc-4e76-802e-0f179b53b20b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Returning 404 to user: Instance 807615f2-1905-4a84-8a8b-574886415dc6 could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:41:50.032153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-74485ed9-abdc-4e76-802e-0f179b53b20b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6" status: 404 len: 111 microversion: 2.1 time: 0.045074 Aug 24 13:41:50.032153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 204/412] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:49 2022] GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:41:50.033785 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-4d184fe4-7eed-4bfd-94b4-41220280e01d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '.version_select at 0x7f96c235ddc0>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:50.038833 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4d184fe4-7eed-4bfd-94b4-41220280e01d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [b971db14-65d5-49a9-a46e-18969e680b41] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 13:41:50.376299 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-67157383-b21a-4404-9f8c-df4c1c7e1575 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:50.376932 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-67157383-b21a-4404-9f8c-df4c1c7e1575 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:50.384494 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-67157383-b21a-4404-9f8c-df4c1c7e1575 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:50.385502 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-67157383-b21a-4404-9f8c-df4c1c7e1575 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:50.386187 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-67157383-b21a-4404-9f8c-df4c1c7e1575 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:50.387204 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-67157383-b21a-4404-9f8c-df4c1c7e1575 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:50.388509 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-67157383-b21a-4404-9f8c-df4c1c7e1575 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:50.388957 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-67157383-b21a-4404-9f8c-df4c1c7e1575 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:50.567422 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-67157383-b21a-4404-9f8c-df4c1c7e1575 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:50.576734 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-67157383-b21a-4404-9f8c-df4c1c7e1575 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.204551 Aug 24 13:41:50.577700 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 205/413] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:50 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:41:50.619082 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-8050179b-98ba-4fb6-bd8a-15a709e61531 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-102194556", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1608228831", "security_groups": [{"name": "tempest-secgroup-smoke-1764738581"}], "networks": [{"uuid": "2a47b7b8-8e69-4dcf-8155-1e0d50419209"}], "block_device_mapping_v2": [{"uuid": "6c2f77e9-193e-464d-bb17-38288091a0b2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:41:50.759566 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.network.neutron [None req-8050179b-98ba-4fb6-bd8a-15a709e61531 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] validate_networks() for [('2a47b7b8-8e69-4dcf-8155-1e0d50419209', None, None, None, None, None)] {{(pid=133014) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:41:51.057624 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO oslo.messaging._drivers.impl_rabbit [None req-4d184fe4-7eed-4bfd-94b4-41220280e01d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [b971db14-65d5-49a9-a46e-18969e680b41] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 46868. Aug 24 13:41:51.196621 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-4d184fe4-7eed-4bfd-94b4-41220280e01d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1348800994" status: 202 len: 0 microversion: 2.1 time: 1.159885 Aug 24 13:41:51.196621 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 209/414] 10.222.0.73 () {58 vars in 1221 bytes} [Wed Aug 24 13:41:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1348800994 => generated 0 bytes in 1162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:41:51.196621 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a4778285-ec97-42bd-962a-f1d64549c1b1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:51.197787 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-a4778285-ec97-42bd-962a-f1d64549c1b1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:51.206674 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a4778285-ec97-42bd-962a-f1d64549c1b1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:51.207583 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a4778285-ec97-42bd-962a-f1d64549c1b1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:51.208298 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a4778285-ec97-42bd-962a-f1d64549c1b1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:51.209283 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a4778285-ec97-42bd-962a-f1d64549c1b1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:51.210247 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a4778285-ec97-42bd-962a-f1d64549c1b1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:51.211189 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a4778285-ec97-42bd-962a-f1d64549c1b1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:51.485055 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-a4778285-ec97-42bd-962a-f1d64549c1b1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:51.494468 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-a4778285-ec97-42bd-962a-f1d64549c1b1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:51.497133 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-a4778285-ec97-42bd-962a-f1d64549c1b1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:51.501051 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a4778285-ec97-42bd-962a-f1d64549c1b1 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.307126 Aug 24 13:41:51.501051 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 210/415] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:51 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:51.578990 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-8050179b-98ba-4fb6-bd8a-15a709e61531 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Flavor limits 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:41:51.579735 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-8050179b-98ba-4fb6-bd8a-15a709e61531 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Image limits 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:41:51.580551 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-8050179b-98ba-4fb6-bd8a-15a709e61531 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Flavor pref 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:41:51.581180 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-8050179b-98ba-4fb6-bd8a-15a709e61531 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Image pref 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:41:51.581859 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-8050179b-98ba-4fb6-bd8a-15a709e61531 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:41:51.593050 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8050179b-98ba-4fb6-bd8a-15a709e61531 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:51.594357 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8050179b-98ba-4fb6-bd8a-15a709e61531 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:51.594357 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8050179b-98ba-4fb6-bd8a-15a709e61531 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:51.594815 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8050179b-98ba-4fb6-bd8a-15a709e61531 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:51.595289 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8050179b-98ba-4fb6-bd8a-15a709e61531 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:51.595719 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8050179b-98ba-4fb6-bd8a-15a709e61531 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:51.600707 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-7d536782-c718-44c7-ac8c-9fd62876eac3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:51.603443 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-7d536782-c718-44c7-ac8c-9fd62876eac3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:51.609877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7d536782-c718-44c7-ac8c-9fd62876eac3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:51.610681 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7d536782-c718-44c7-ac8c-9fd62876eac3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:51.611163 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7d536782-c718-44c7-ac8c-9fd62876eac3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:51.611879 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7d536782-c718-44c7-ac8c-9fd62876eac3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:51.612468 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7d536782-c718-44c7-ac8c-9fd62876eac3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:51.612860 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7d536782-c718-44c7-ac8c-9fd62876eac3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:51.615460 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-8050179b-98ba-4fb6-bd8a-15a709e61531 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Getting quotas for project 6bcafe839dec4fcc95a4c720463483ba. Resources: {'instances', 'cores', 'ram'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:41:51.622191 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-8050179b-98ba-4fb6-bd8a-15a709e61531 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Getting quotas for user 2730741d853a4cfcab1bbc990cf42611 and project 6bcafe839dec4fcc95a4c720463483ba. Resources: {'instances', 'cores', 'ram'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:41:51.699804 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-8050179b-98ba-4fb6-bd8a-15a709e61531 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Going to run 1 instances... {{(pid=133014) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 13:41:51.702841 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-8050179b-98ba-4fb6-bd8a-15a709e61531 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6c2f77e9-193e-464d-bb17-38288091a0b2',volume_size=None,volume_type=None)] {{(pid=133014) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 13:41:51.783348 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-7d536782-c718-44c7-ac8c-9fd62876eac3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:51.797644 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-7d536782-c718-44c7-ac8c-9fd62876eac3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.201138 Aug 24 13:41:51.798418 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 211/416] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:51 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:41:52.252136 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b97ff596-b184-40dc-ae3c-aa1edecbd4a5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:52.259089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b97ff596-b184-40dc-ae3c-aa1edecbd4a5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:52.261931 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b97ff596-b184-40dc-ae3c-aa1edecbd4a5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:52.262437 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b97ff596-b184-40dc-ae3c-aa1edecbd4a5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:52.262882 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b97ff596-b184-40dc-ae3c-aa1edecbd4a5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:52.263629 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b97ff596-b184-40dc-ae3c-aa1edecbd4a5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:52.264088 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b97ff596-b184-40dc-ae3c-aa1edecbd4a5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:52.264553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b97ff596-b184-40dc-ae3c-aa1edecbd4a5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:52.269483 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-8050179b-98ba-4fb6-bd8a-15a709e61531 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.653813 Aug 24 13:41:52.281252 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 206/417] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 13:41:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 13:41:52.299088 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-7bedd39e-0926-4995-aea1-01726ab32e99 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:52.300229 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-7bedd39e-0926-4995-aea1-01726ab32e99 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:52.384984 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-7bedd39e-0926-4995-aea1-01726ab32e99 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:52.399719 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-7bedd39e-0926-4995-aea1-01726ab32e99 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1088 microversion: 2.1 time: 0.114263 Aug 24 13:41:52.401089 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 207/418] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:52 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1088 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:41:52.499303 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.objects.instance [None req-b97ff596-b184-40dc-ae3c-aa1edecbd4a5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lazy-loading 'services' on Instance uuid 3ad88e6d-b2b8-4049-b987-94022767fa67 {{(pid=133015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:41:52.523221 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-27e90fa6-d490-4655-a0bf-5e0a30e495aa tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:52.524058 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-27e90fa6-d490-4655-a0bf-5e0a30e495aa tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:52.531304 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-27e90fa6-d490-4655-a0bf-5e0a30e495aa tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:52.531780 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-27e90fa6-d490-4655-a0bf-5e0a30e495aa tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:52.532232 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-27e90fa6-d490-4655-a0bf-5e0a30e495aa tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:52.533295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-27e90fa6-d490-4655-a0bf-5e0a30e495aa tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:52.533756 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-27e90fa6-d490-4655-a0bf-5e0a30e495aa tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:52.534212 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-27e90fa6-d490-4655-a0bf-5e0a30e495aa tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:52.720324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-27e90fa6-d490-4655-a0bf-5e0a30e495aa tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:52.729403 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-27e90fa6-d490-4655-a0bf-5e0a30e495aa tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:52.731492 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-27e90fa6-d490-4655-a0bf-5e0a30e495aa tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:52.732732 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-27e90fa6-d490-4655-a0bf-5e0a30e495aa tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.214440 Aug 24 13:41:52.733288 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 208/419] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:52 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:41:52.819731 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-ebd3c2f8-e4ab-4509-9cd2-b2594e13181d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:52.820398 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-ebd3c2f8-e4ab-4509-9cd2-b2594e13181d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:52.826732 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ebd3c2f8-e4ab-4509-9cd2-b2594e13181d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:52.827228 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ebd3c2f8-e4ab-4509-9cd2-b2594e13181d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:52.827665 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ebd3c2f8-e4ab-4509-9cd2-b2594e13181d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:52.828399 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ebd3c2f8-e4ab-4509-9cd2-b2594e13181d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:52.828863 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ebd3c2f8-e4ab-4509-9cd2-b2594e13181d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:52.829284 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ebd3c2f8-e4ab-4509-9cd2-b2594e13181d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:52.861873 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b97ff596-b184-40dc-ae3c-aa1edecbd4a5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments/0f4377f2-a0f1-4473-af0f-7b4b14e0661b" status: 202 len: 0 microversion: 2.1 time: 0.614203 Aug 24 13:41:52.862764 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 212/420] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 13:41:52 2022] DELETE /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments/0f4377f2-a0f1-4473-af0f-7b4b14e0661b => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 13:41:52.873170 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-11eb978d-ec76-42b1-8abd-39e6cff2e17c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:52.875788 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-11eb978d-ec76-42b1-8abd-39e6cff2e17c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:52.882375 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-11eb978d-ec76-42b1-8abd-39e6cff2e17c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:52.882868 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-11eb978d-ec76-42b1-8abd-39e6cff2e17c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:52.883299 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-11eb978d-ec76-42b1-8abd-39e6cff2e17c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:52.884003 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-11eb978d-ec76-42b1-8abd-39e6cff2e17c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:52.884489 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-11eb978d-ec76-42b1-8abd-39e6cff2e17c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:52.884907 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-11eb978d-ec76-42b1-8abd-39e6cff2e17c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:52.923637 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-11eb978d-ec76-42b1-8abd-39e6cff2e17c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055833 Aug 24 13:41:52.924457 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 213/421] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:41:52 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:41:52.977682 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-ebd3c2f8-e4ab-4509-9cd2-b2594e13181d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:52.987350 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-ebd3c2f8-e4ab-4509-9cd2-b2594e13181d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.171411 Aug 24 13:41:52.988763 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 209/422] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:52 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:41:53.435372 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-52fd7298-f553-4b21-8908-4c399cf32591 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:53.436333 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-52fd7298-f553-4b21-8908-4c399cf32591 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:53.500569 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-52fd7298-f553-4b21-8908-4c399cf32591 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:53.513749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-52fd7298-f553-4b21-8908-4c399cf32591 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1088 microversion: 2.1 time: 0.082305 Aug 24 13:41:53.514649 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 214/423] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:53 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1088 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:53.761622 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-9aa6f515-4848-4e21-a26b-c29c41e06e7f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:53.762376 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-9aa6f515-4848-4e21-a26b-c29c41e06e7f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:53.769289 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9aa6f515-4848-4e21-a26b-c29c41e06e7f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:53.769787 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9aa6f515-4848-4e21-a26b-c29c41e06e7f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:53.770226 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9aa6f515-4848-4e21-a26b-c29c41e06e7f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:53.771383 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9aa6f515-4848-4e21-a26b-c29c41e06e7f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:53.771895 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9aa6f515-4848-4e21-a26b-c29c41e06e7f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:53.772476 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9aa6f515-4848-4e21-a26b-c29c41e06e7f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:53.938571 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-450aa1f2-a18b-43be-a3ce-d78ef44605a4 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:53.940952 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-450aa1f2-a18b-43be-a3ce-d78ef44605a4 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:53.948213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-450aa1f2-a18b-43be-a3ce-d78ef44605a4 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:53.948760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-450aa1f2-a18b-43be-a3ce-d78ef44605a4 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:53.950525 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-450aa1f2-a18b-43be-a3ce-d78ef44605a4 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:53.951689 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-450aa1f2-a18b-43be-a3ce-d78ef44605a4 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:53.952345 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-450aa1f2-a18b-43be-a3ce-d78ef44605a4 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:53.952902 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-450aa1f2-a18b-43be-a3ce-d78ef44605a4 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:53.969647 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-9aa6f515-4848-4e21-a26b-c29c41e06e7f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:53.998270 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-9aa6f515-4848-4e21-a26b-c29c41e06e7f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:54.000012 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-450aa1f2-a18b-43be-a3ce-d78ef44605a4 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066604 Aug 24 13:41:54.001091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 215/424] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:41:53 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:41:54.004328 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-9aa6f515-4848-4e21-a26b-c29c41e06e7f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:54.007678 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-9aa6f515-4848-4e21-a26b-c29c41e06e7f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.249811 Aug 24 13:41:54.008855 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 210/425] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:53 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:41:54.017130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-01b521ad-b568-40c4-a00d-ceacd8f73798 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:54.017763 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-01b521ad-b568-40c4-a00d-ceacd8f73798 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:54.025814 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-01b521ad-b568-40c4-a00d-ceacd8f73798 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:54.026900 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-01b521ad-b568-40c4-a00d-ceacd8f73798 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:54.027840 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-01b521ad-b568-40c4-a00d-ceacd8f73798 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:54.028818 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-01b521ad-b568-40c4-a00d-ceacd8f73798 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:54.029616 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-01b521ad-b568-40c4-a00d-ceacd8f73798 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:54.030160 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-01b521ad-b568-40c4-a00d-ceacd8f73798 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:54.233863 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-01b521ad-b568-40c4-a00d-ceacd8f73798 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:54.244675 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-01b521ad-b568-40c4-a00d-ceacd8f73798 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.234693 Aug 24 13:41:54.245333 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 216/426] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:54 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:41:54.550606 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-6896e9aa-029d-4cc7-8ac0-5f7b14003525 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:54.551229 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-6896e9aa-029d-4cc7-8ac0-5f7b14003525 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:54.558827 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6896e9aa-029d-4cc7-8ac0-5f7b14003525 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:54.559345 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6896e9aa-029d-4cc7-8ac0-5f7b14003525 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:54.559805 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6896e9aa-029d-4cc7-8ac0-5f7b14003525 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:54.560918 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6896e9aa-029d-4cc7-8ac0-5f7b14003525 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:54.561628 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6896e9aa-029d-4cc7-8ac0-5f7b14003525 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:54.562349 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6896e9aa-029d-4cc7-8ac0-5f7b14003525 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:54.658038 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-6896e9aa-029d-4cc7-8ac0-5f7b14003525 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:54.667693 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-6896e9aa-029d-4cc7-8ac0-5f7b14003525 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1138 microversion: 2.1 time: 0.121185 Aug 24 13:41:54.668409 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 211/427] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:54 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1138 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:55.016861 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-ae54fddd-6354-4ded-ae0b-7f16104095f9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:55.021481 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-ae54fddd-6354-4ded-ae0b-7f16104095f9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:55.026737 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ae54fddd-6354-4ded-ae0b-7f16104095f9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:55.027550 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ae54fddd-6354-4ded-ae0b-7f16104095f9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:55.028006 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ae54fddd-6354-4ded-ae0b-7f16104095f9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:55.028764 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ae54fddd-6354-4ded-ae0b-7f16104095f9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:55.029223 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ae54fddd-6354-4ded-ae0b-7f16104095f9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:55.029644 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ae54fddd-6354-4ded-ae0b-7f16104095f9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:55.040952 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-598d8c10-fee1-4c45-ae7f-de702d86665f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:55.041625 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-598d8c10-fee1-4c45-ae7f-de702d86665f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:55.048800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-598d8c10-fee1-4c45-ae7f-de702d86665f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:55.049300 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-598d8c10-fee1-4c45-ae7f-de702d86665f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:55.049737 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-598d8c10-fee1-4c45-ae7f-de702d86665f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:55.050444 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-598d8c10-fee1-4c45-ae7f-de702d86665f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:55.050901 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-598d8c10-fee1-4c45-ae7f-de702d86665f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:55.051324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-598d8c10-fee1-4c45-ae7f-de702d86665f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:55.064253 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-ae54fddd-6354-4ded-ae0b-7f16104095f9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052312 Aug 24 13:41:55.070765 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 217/428] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:41:55 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:41:55.203588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-598d8c10-fee1-4c45-ae7f-de702d86665f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:55.213754 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-598d8c10-fee1-4c45-ae7f-de702d86665f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:55.215413 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-598d8c10-fee1-4c45-ae7f-de702d86665f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:55.216673 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-598d8c10-fee1-4c45-ae7f-de702d86665f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.179984 Aug 24 13:41:55.217258 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 212/429] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:55 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:41:55.270139 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-c3df1678-ebe4-4cd8-a85c-16d99a72b16d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:55.270783 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-c3df1678-ebe4-4cd8-a85c-16d99a72b16d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:55.278265 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c3df1678-ebe4-4cd8-a85c-16d99a72b16d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:55.278768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c3df1678-ebe4-4cd8-a85c-16d99a72b16d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:55.279213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c3df1678-ebe4-4cd8-a85c-16d99a72b16d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:55.279933 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c3df1678-ebe4-4cd8-a85c-16d99a72b16d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:55.280425 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c3df1678-ebe4-4cd8-a85c-16d99a72b16d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:55.280856 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c3df1678-ebe4-4cd8-a85c-16d99a72b16d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:55.426947 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c3df1678-ebe4-4cd8-a85c-16d99a72b16d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:55.441520 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-c3df1678-ebe4-4cd8-a85c-16d99a72b16d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.175191 Aug 24 13:41:55.442112 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 218/430] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:55 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:55.688885 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-d22a3814-4cb3-4059-bd5f-efacc4f358cc tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:55.689532 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-d22a3814-4cb3-4059-bd5f-efacc4f358cc tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:55.695743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d22a3814-4cb3-4059-bd5f-efacc4f358cc tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:55.696272 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d22a3814-4cb3-4059-bd5f-efacc4f358cc tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:55.696712 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d22a3814-4cb3-4059-bd5f-efacc4f358cc tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:55.697409 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d22a3814-4cb3-4059-bd5f-efacc4f358cc tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:55.697864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d22a3814-4cb3-4059-bd5f-efacc4f358cc tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:55.698916 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d22a3814-4cb3-4059-bd5f-efacc4f358cc tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:55.774508 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-d22a3814-4cb3-4059-bd5f-efacc4f358cc tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:55.782848 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-d22a3814-4cb3-4059-bd5f-efacc4f358cc tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1138 microversion: 2.1 time: 0.098221 Aug 24 13:41:55.783423 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 213/431] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:55 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1138 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:56.079805 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-6f24fa8b-3b84-4702-9d26-aa75cb6e7971 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:56.081992 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-6f24fa8b-3b84-4702-9d26-aa75cb6e7971 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:56.089761 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f24fa8b-3b84-4702-9d26-aa75cb6e7971 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:56.090250 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f24fa8b-3b84-4702-9d26-aa75cb6e7971 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:56.090816 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f24fa8b-3b84-4702-9d26-aa75cb6e7971 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:56.091527 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f24fa8b-3b84-4702-9d26-aa75cb6e7971 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:56.091975 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f24fa8b-3b84-4702-9d26-aa75cb6e7971 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:56.092432 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f24fa8b-3b84-4702-9d26-aa75cb6e7971 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:56.124637 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-6f24fa8b-3b84-4702-9d26-aa75cb6e7971 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048982 Aug 24 13:41:56.125217 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 219/432] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:41:56 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:41:56.239416 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a69b5d81-3026-45d9-8885-e407bfb4f29f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:56.240161 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a69b5d81-3026-45d9-8885-e407bfb4f29f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:56.246990 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a69b5d81-3026-45d9-8885-e407bfb4f29f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:56.247492 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a69b5d81-3026-45d9-8885-e407bfb4f29f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:56.247941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a69b5d81-3026-45d9-8885-e407bfb4f29f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:56.248697 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a69b5d81-3026-45d9-8885-e407bfb4f29f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:56.249162 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a69b5d81-3026-45d9-8885-e407bfb4f29f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:56.249589 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a69b5d81-3026-45d9-8885-e407bfb4f29f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:56.271713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:41:56.397704 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a69b5d81-3026-45d9-8885-e407bfb4f29f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:56.408120 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a69b5d81-3026-45d9-8885-e407bfb4f29f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:56.409653 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a69b5d81-3026-45d9-8885-e407bfb4f29f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:56.410816 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a69b5d81-3026-45d9-8885-e407bfb4f29f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.175668 Aug 24 13:41:56.411377 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 214/433] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:56 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:56.462925 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-41df8369-d419-4f1d-a47b-dd5888d808f7 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:56.463543 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-41df8369-d419-4f1d-a47b-dd5888d808f7 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:56.470316 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-41df8369-d419-4f1d-a47b-dd5888d808f7 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:56.470810 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-41df8369-d419-4f1d-a47b-dd5888d808f7 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:56.471250 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-41df8369-d419-4f1d-a47b-dd5888d808f7 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:56.471965 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-41df8369-d419-4f1d-a47b-dd5888d808f7 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:56.472465 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-41df8369-d419-4f1d-a47b-dd5888d808f7 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:56.472897 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-41df8369-d419-4f1d-a47b-dd5888d808f7 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:56.611885 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-41df8369-d419-4f1d-a47b-dd5888d808f7 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:56.624851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-41df8369-d419-4f1d-a47b-dd5888d808f7 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.165764 Aug 24 13:41:56.625440 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 220/434] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:56 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:56.805424 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e4729e89-9f1a-4e55-b443-c2f9eac26e8b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:56.806132 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-e4729e89-9f1a-4e55-b443-c2f9eac26e8b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:56.813618 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e4729e89-9f1a-4e55-b443-c2f9eac26e8b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:56.815036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e4729e89-9f1a-4e55-b443-c2f9eac26e8b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:56.815036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e4729e89-9f1a-4e55-b443-c2f9eac26e8b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:56.815227 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e4729e89-9f1a-4e55-b443-c2f9eac26e8b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:56.815666 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e4729e89-9f1a-4e55-b443-c2f9eac26e8b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:56.816083 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e4729e89-9f1a-4e55-b443-c2f9eac26e8b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:56.888063 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e4729e89-9f1a-4e55-b443-c2f9eac26e8b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:56.896766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-e4729e89-9f1a-4e55-b443-c2f9eac26e8b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1138 microversion: 2.1 time: 0.095402 Aug 24 13:41:56.897369 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 215/435] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:56 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1138 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:57.138200 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-2f442501-07eb-406f-800b-c06f5d6e8f67 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:57.140480 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-2f442501-07eb-406f-800b-c06f5d6e8f67 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:57.147846 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f442501-07eb-406f-800b-c06f5d6e8f67 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:57.148370 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f442501-07eb-406f-800b-c06f5d6e8f67 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:57.148807 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f442501-07eb-406f-800b-c06f5d6e8f67 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:57.149562 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f442501-07eb-406f-800b-c06f5d6e8f67 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:57.150012 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f442501-07eb-406f-800b-c06f5d6e8f67 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:57.150427 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f442501-07eb-406f-800b-c06f5d6e8f67 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:57.184733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-2f442501-07eb-406f-800b-c06f5d6e8f67 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051344 Aug 24 13:41:57.185326 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 221/436] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:41:57 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:41:57.434687 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-6b40d1e0-77b4-492d-936a-f712237f524f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:57.435238 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-6b40d1e0-77b4-492d-936a-f712237f524f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:57.442138 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6b40d1e0-77b4-492d-936a-f712237f524f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:57.442860 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6b40d1e0-77b4-492d-936a-f712237f524f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:57.443336 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6b40d1e0-77b4-492d-936a-f712237f524f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:57.444077 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6b40d1e0-77b4-492d-936a-f712237f524f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:57.444609 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6b40d1e0-77b4-492d-936a-f712237f524f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:57.445036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6b40d1e0-77b4-492d-936a-f712237f524f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:57.586438 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-6b40d1e0-77b4-492d-936a-f712237f524f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:57.596562 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-6b40d1e0-77b4-492d-936a-f712237f524f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:57.598153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-6b40d1e0-77b4-492d-936a-f712237f524f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:57.599345 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-6b40d1e0-77b4-492d-936a-f712237f524f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.169693 Aug 24 13:41:57.599920 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 216/437] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:57 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:57.648171 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-3b9264e3-12a5-4a92-b2a1-c52a6cdb7474 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:57.648828 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-3b9264e3-12a5-4a92-b2a1-c52a6cdb7474 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:57.655717 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3b9264e3-12a5-4a92-b2a1-c52a6cdb7474 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:57.656250 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3b9264e3-12a5-4a92-b2a1-c52a6cdb7474 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:57.656698 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3b9264e3-12a5-4a92-b2a1-c52a6cdb7474 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:57.657450 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3b9264e3-12a5-4a92-b2a1-c52a6cdb7474 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:57.657915 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3b9264e3-12a5-4a92-b2a1-c52a6cdb7474 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:57.658346 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3b9264e3-12a5-4a92-b2a1-c52a6cdb7474 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:57.813088 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-3b9264e3-12a5-4a92-b2a1-c52a6cdb7474 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:57.821433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-3b9264e3-12a5-4a92-b2a1-c52a6cdb7474 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.177342 Aug 24 13:41:57.821884 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 222/438] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:57 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:57.921368 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-25945bd7-b08e-45b9-b575-297e9052b3be tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:57.922060 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-25945bd7-b08e-45b9-b575-297e9052b3be tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:57.928780 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-25945bd7-b08e-45b9-b575-297e9052b3be tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:57.929275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-25945bd7-b08e-45b9-b575-297e9052b3be tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:57.929739 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-25945bd7-b08e-45b9-b575-297e9052b3be tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:57.930445 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-25945bd7-b08e-45b9-b575-297e9052b3be tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:57.930910 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-25945bd7-b08e-45b9-b575-297e9052b3be tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:57.931335 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-25945bd7-b08e-45b9-b575-297e9052b3be tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:58.004058 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-25945bd7-b08e-45b9-b575-297e9052b3be tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:58.012426 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-25945bd7-b08e-45b9-b575-297e9052b3be tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1138 microversion: 2.1 time: 0.095724 Aug 24 13:41:58.013044 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 217/439] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:57 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1138 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:41:58.197245 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-131e74db-0b31-452c-9200-14a1c2c7cac9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:58.199801 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-131e74db-0b31-452c-9200-14a1c2c7cac9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:58.207329 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-131e74db-0b31-452c-9200-14a1c2c7cac9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:58.207879 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-131e74db-0b31-452c-9200-14a1c2c7cac9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:58.208558 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-131e74db-0b31-452c-9200-14a1c2c7cac9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:58.209311 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-131e74db-0b31-452c-9200-14a1c2c7cac9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:58.209774 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-131e74db-0b31-452c-9200-14a1c2c7cac9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:58.210205 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-131e74db-0b31-452c-9200-14a1c2c7cac9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:58.242186 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-131e74db-0b31-452c-9200-14a1c2c7cac9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048975 Aug 24 13:41:58.242779 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 223/440] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:41:58 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:41:58.627638 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-cf55175a-e6a7-449f-ad79-bf36f5c09689 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:58.628920 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-cf55175a-e6a7-449f-ad79-bf36f5c09689 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:58.640014 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cf55175a-e6a7-449f-ad79-bf36f5c09689 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:58.640559 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cf55175a-e6a7-449f-ad79-bf36f5c09689 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:58.641012 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cf55175a-e6a7-449f-ad79-bf36f5c09689 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:58.641740 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cf55175a-e6a7-449f-ad79-bf36f5c09689 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:58.642212 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cf55175a-e6a7-449f-ad79-bf36f5c09689 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:58.642682 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cf55175a-e6a7-449f-ad79-bf36f5c09689 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:58.824817 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-cf55175a-e6a7-449f-ad79-bf36f5c09689 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:58.844813 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a664663b-f63b-42b3-ab16-26f5177790ea tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:58.848966 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-a664663b-f63b-42b3-ab16-26f5177790ea tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:58.850513 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-cf55175a-e6a7-449f-ad79-bf36f5c09689 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:58.854283 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-cf55175a-e6a7-449f-ad79-bf36f5c09689 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:58.857238 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-cf55175a-e6a7-449f-ad79-bf36f5c09689 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.236472 Aug 24 13:41:58.858748 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 218/441] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:58 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:41:58.860486 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a664663b-f63b-42b3-ab16-26f5177790ea tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:58.861447 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a664663b-f63b-42b3-ab16-26f5177790ea tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:58.862160 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a664663b-f63b-42b3-ab16-26f5177790ea tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:58.863098 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a664663b-f63b-42b3-ab16-26f5177790ea tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:58.863905 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a664663b-f63b-42b3-ab16-26f5177790ea tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:58.864598 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a664663b-f63b-42b3-ab16-26f5177790ea tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:58.888576 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:41:59.032382 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-a664663b-f63b-42b3-ab16-26f5177790ea tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:59.033317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-686f33a3-8274-48f6-907f-cb0be23aa85f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:59.033953 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-686f33a3-8274-48f6-907f-cb0be23aa85f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:59.040455 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-686f33a3-8274-48f6-907f-cb0be23aa85f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:59.040935 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a664663b-f63b-42b3-ab16-26f5177790ea tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.201621 Aug 24 13:41:59.041110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-686f33a3-8274-48f6-907f-cb0be23aa85f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:59.041395 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-686f33a3-8274-48f6-907f-cb0be23aa85f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:59.041602 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 224/442] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:58 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:41:59.042786 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-686f33a3-8274-48f6-907f-cb0be23aa85f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:59.043347 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-686f33a3-8274-48f6-907f-cb0be23aa85f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:59.043781 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-686f33a3-8274-48f6-907f-cb0be23aa85f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:59.117801 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-686f33a3-8274-48f6-907f-cb0be23aa85f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:41:59.126572 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-686f33a3-8274-48f6-907f-cb0be23aa85f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1138 microversion: 2.1 time: 0.097149 Aug 24 13:41:59.127154 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 219/443] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:41:59 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1138 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:41:59.255420 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-709c1f4e-32f4-490c-bdda-374d253d35a0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:59.257517 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-709c1f4e-32f4-490c-bdda-374d253d35a0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:59.265224 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-709c1f4e-32f4-490c-bdda-374d253d35a0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:59.265740 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-709c1f4e-32f4-490c-bdda-374d253d35a0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:59.266177 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-709c1f4e-32f4-490c-bdda-374d253d35a0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:59.266872 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-709c1f4e-32f4-490c-bdda-374d253d35a0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:59.267335 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-709c1f4e-32f4-490c-bdda-374d253d35a0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:59.267813 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-709c1f4e-32f4-490c-bdda-374d253d35a0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:59.300406 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-709c1f4e-32f4-490c-bdda-374d253d35a0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049134 Aug 24 13:41:59.301004 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 225/444] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:41:59 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:41:59.882178 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-205d4b6d-e2b9-4576-8c3e-cb5a68d88660 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:41:59.882866 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-205d4b6d-e2b9-4576-8c3e-cb5a68d88660 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:41:59.890954 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-205d4b6d-e2b9-4576-8c3e-cb5a68d88660 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:59.891505 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-205d4b6d-e2b9-4576-8c3e-cb5a68d88660 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:59.892092 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-205d4b6d-e2b9-4576-8c3e-cb5a68d88660 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:41:59.892650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-205d4b6d-e2b9-4576-8c3e-cb5a68d88660 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:41:59.893115 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-205d4b6d-e2b9-4576-8c3e-cb5a68d88660 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:41:59.893559 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-205d4b6d-e2b9-4576-8c3e-cb5a68d88660 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:00.056931 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-205d4b6d-e2b9-4576-8c3e-cb5a68d88660 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:00.066984 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-89307d4b-b625-4b6b-a89a-ebb797a55e0c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:00.067565 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-205d4b6d-e2b9-4576-8c3e-cb5a68d88660 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:00.067739 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-89307d4b-b625-4b6b-a89a-ebb797a55e0c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:00.069165 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-205d4b6d-e2b9-4576-8c3e-cb5a68d88660 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:00.070488 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-205d4b6d-e2b9-4576-8c3e-cb5a68d88660 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.192656 Aug 24 13:42:00.071220 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 220/445] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:41:59 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:42:00.074910 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-89307d4b-b625-4b6b-a89a-ebb797a55e0c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:00.075423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-89307d4b-b625-4b6b-a89a-ebb797a55e0c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:00.075927 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-89307d4b-b625-4b6b-a89a-ebb797a55e0c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:00.076670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-89307d4b-b625-4b6b-a89a-ebb797a55e0c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:00.077125 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-89307d4b-b625-4b6b-a89a-ebb797a55e0c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:00.077542 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-89307d4b-b625-4b6b-a89a-ebb797a55e0c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:00.148467 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a21791c3-de29-4ef7-a866-c756403f94fa tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:00.149472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a21791c3-de29-4ef7-a866-c756403f94fa tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:00.157456 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a21791c3-de29-4ef7-a866-c756403f94fa tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:00.157965 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a21791c3-de29-4ef7-a866-c756403f94fa tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:00.158408 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a21791c3-de29-4ef7-a866-c756403f94fa tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:00.159154 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a21791c3-de29-4ef7-a866-c756403f94fa tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:00.159613 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a21791c3-de29-4ef7-a866-c756403f94fa tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:00.160051 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a21791c3-de29-4ef7-a866-c756403f94fa tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:00.249702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a21791c3-de29-4ef7-a866-c756403f94fa tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:00.264384 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a21791c3-de29-4ef7-a866-c756403f94fa tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1138 microversion: 2.1 time: 0.119762 Aug 24 13:42:00.265443 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 221/446] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:00 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1138 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:42:00.279653 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-89307d4b-b625-4b6b-a89a-ebb797a55e0c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:00.288503 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-89307d4b-b625-4b6b-a89a-ebb797a55e0c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.228421 Aug 24 13:42:00.289255 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 226/447] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:00 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:42:00.317180 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-3dcbbfdc-0790-4b15-b486-453cbecaa6c5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:00.321333 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-3dcbbfdc-0790-4b15-b486-453cbecaa6c5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:00.333517 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3dcbbfdc-0790-4b15-b486-453cbecaa6c5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:00.334885 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3dcbbfdc-0790-4b15-b486-453cbecaa6c5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:00.335352 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3dcbbfdc-0790-4b15-b486-453cbecaa6c5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:00.336671 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3dcbbfdc-0790-4b15-b486-453cbecaa6c5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:00.337512 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3dcbbfdc-0790-4b15-b486-453cbecaa6c5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:00.338288 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3dcbbfdc-0790-4b15-b486-453cbecaa6c5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:00.376868 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-3dcbbfdc-0790-4b15-b486-453cbecaa6c5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067398 Aug 24 13:42:00.377453 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 222/448] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:42:00 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:42:01.096805 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-7a77f3e9-268b-464d-87fd-8b8014208d76 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:01.097933 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-7a77f3e9-268b-464d-87fd-8b8014208d76 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:01.104447 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7a77f3e9-268b-464d-87fd-8b8014208d76 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:01.105135 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7a77f3e9-268b-464d-87fd-8b8014208d76 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:01.105929 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7a77f3e9-268b-464d-87fd-8b8014208d76 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:01.106621 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7a77f3e9-268b-464d-87fd-8b8014208d76 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:01.107162 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7a77f3e9-268b-464d-87fd-8b8014208d76 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:01.107838 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7a77f3e9-268b-464d-87fd-8b8014208d76 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:01.274336 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-7a77f3e9-268b-464d-87fd-8b8014208d76 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:01.285561 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-7a77f3e9-268b-464d-87fd-8b8014208d76 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:01.287071 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-7a77f3e9-268b-464d-87fd-8b8014208d76 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:01.289175 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-7a77f3e9-268b-464d-87fd-8b8014208d76 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.196790 Aug 24 13:42:01.289883 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 227/449] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:42:01 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:42:01.290860 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-cc1841f7-1a2f-4b5b-ac09-a6005bab96fd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:01.291505 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-cc1841f7-1a2f-4b5b-ac09-a6005bab96fd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:01.301137 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cc1841f7-1a2f-4b5b-ac09-a6005bab96fd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:01.301674 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cc1841f7-1a2f-4b5b-ac09-a6005bab96fd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:01.302219 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cc1841f7-1a2f-4b5b-ac09-a6005bab96fd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:01.302842 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cc1841f7-1a2f-4b5b-ac09-a6005bab96fd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:01.303306 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cc1841f7-1a2f-4b5b-ac09-a6005bab96fd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:01.303753 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cc1841f7-1a2f-4b5b-ac09-a6005bab96fd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:01.314470 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-09699e16-ab63-48da-8661-62bbd5e6edd7 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:01.315481 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-09699e16-ab63-48da-8661-62bbd5e6edd7 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:01.322237 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-09699e16-ab63-48da-8661-62bbd5e6edd7 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:01.322749 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-09699e16-ab63-48da-8661-62bbd5e6edd7 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:01.323360 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-09699e16-ab63-48da-8661-62bbd5e6edd7 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:01.324154 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-09699e16-ab63-48da-8661-62bbd5e6edd7 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:01.324967 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-09699e16-ab63-48da-8661-62bbd5e6edd7 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:01.325312 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-09699e16-ab63-48da-8661-62bbd5e6edd7 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:01.411962 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-cc1841f7-1a2f-4b5b-ac09-a6005bab96fd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:01.427073 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-cc1841f7-1a2f-4b5b-ac09-a6005bab96fd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1130 microversion: 2.1 time: 0.138839 Aug 24 13:42:01.427689 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 223/450] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:01 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1130 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:42:01.433114 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-224e3868-8045-4e35-84c1-c2ce83a0cffe tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:01.435350 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-224e3868-8045-4e35-84c1-c2ce83a0cffe tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:01.445694 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-224e3868-8045-4e35-84c1-c2ce83a0cffe tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:01.446032 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-224e3868-8045-4e35-84c1-c2ce83a0cffe tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:01.446561 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-224e3868-8045-4e35-84c1-c2ce83a0cffe tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:01.447614 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-224e3868-8045-4e35-84c1-c2ce83a0cffe tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:01.447742 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-224e3868-8045-4e35-84c1-c2ce83a0cffe tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:01.448293 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-224e3868-8045-4e35-84c1-c2ce83a0cffe tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:01.489586 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-224e3868-8045-4e35-84c1-c2ce83a0cffe tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060707 Aug 24 13:42:01.490332 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 224/451] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:42:01 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:42:01.527670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-09699e16-ab63-48da-8661-62bbd5e6edd7 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:01.540257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-09699e16-ab63-48da-8661-62bbd5e6edd7 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.231339 Aug 24 13:42:01.540851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 228/452] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:01 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:02.322335 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-cd50f365-9d6f-4e1a-9c13-39fe3f3936b5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:02.322976 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-cd50f365-9d6f-4e1a-9c13-39fe3f3936b5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:02.325014 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=2 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:42:02.330198 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cd50f365-9d6f-4e1a-9c13-39fe3f3936b5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:02.330669 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cd50f365-9d6f-4e1a-9c13-39fe3f3936b5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:02.331106 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cd50f365-9d6f-4e1a-9c13-39fe3f3936b5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:02.331908 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cd50f365-9d6f-4e1a-9c13-39fe3f3936b5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:02.332417 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cd50f365-9d6f-4e1a-9c13-39fe3f3936b5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:02.332858 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cd50f365-9d6f-4e1a-9c13-39fe3f3936b5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:02.392743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=8 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:42:02.455393 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-9dfe9abb-80d8-42c9-9d6c-621873c51241 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:02.456575 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-9dfe9abb-80d8-42c9-9d6c-621873c51241 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:02.463220 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9dfe9abb-80d8-42c9-9d6c-621873c51241 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:02.464304 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9dfe9abb-80d8-42c9-9d6c-621873c51241 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:02.464776 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9dfe9abb-80d8-42c9-9d6c-621873c51241 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:02.465452 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9dfe9abb-80d8-42c9-9d6c-621873c51241 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:02.465904 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9dfe9abb-80d8-42c9-9d6c-621873c51241 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:02.466329 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9dfe9abb-80d8-42c9-9d6c-621873c51241 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:02.501847 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-cd50f365-9d6f-4e1a-9c13-39fe3f3936b5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:02.512824 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-cd50f365-9d6f-4e1a-9c13-39fe3f3936b5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:02.514433 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-cd50f365-9d6f-4e1a-9c13-39fe3f3936b5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:02.515659 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-cd50f365-9d6f-4e1a-9c13-39fe3f3936b5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.197412 Aug 24 13:42:02.516244 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 225/453] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:42:02 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:42:02.521288 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-782db7db-5c7e-4d61-996b-bd29c06dde3d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:02.523499 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-782db7db-5c7e-4d61-996b-bd29c06dde3d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:02.530582 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-782db7db-5c7e-4d61-996b-bd29c06dde3d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:02.531079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-782db7db-5c7e-4d61-996b-bd29c06dde3d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:02.531518 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-782db7db-5c7e-4d61-996b-bd29c06dde3d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:02.535011 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-9dfe9abb-80d8-42c9-9d6c-621873c51241 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:02.536641 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-782db7db-5c7e-4d61-996b-bd29c06dde3d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:02.537171 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-782db7db-5c7e-4d61-996b-bd29c06dde3d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:02.537632 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-782db7db-5c7e-4d61-996b-bd29c06dde3d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:02.547472 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-9dfe9abb-80d8-42c9-9d6c-621873c51241 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1130 microversion: 2.1 time: 0.095890 Aug 24 13:42:02.552340 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 229/454] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:02 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1130 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:02.571465 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-c12ec116-54da-4268-a66a-93cae6273218 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:02.572262 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-c12ec116-54da-4268-a66a-93cae6273218 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:02.575945 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-782db7db-5c7e-4d61-996b-bd29c06dde3d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058457 Aug 24 13:42:02.576563 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 226/455] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:42:02 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:42:02.582373 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c12ec116-54da-4268-a66a-93cae6273218 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:02.582871 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c12ec116-54da-4268-a66a-93cae6273218 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:02.583312 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c12ec116-54da-4268-a66a-93cae6273218 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:02.584019 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c12ec116-54da-4268-a66a-93cae6273218 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:02.584533 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c12ec116-54da-4268-a66a-93cae6273218 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:02.584960 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c12ec116-54da-4268-a66a-93cae6273218 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:02.750533 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c12ec116-54da-4268-a66a-93cae6273218 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:02.758762 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-c12ec116-54da-4268-a66a-93cae6273218 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.197707 Aug 24 13:42:02.759345 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 230/456] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:02 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:03.544472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-97f2b3b5-902e-470d-b494-84dbd0072c49 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:03.545324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-97f2b3b5-902e-470d-b494-84dbd0072c49 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:03.551410 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97f2b3b5-902e-470d-b494-84dbd0072c49 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:03.556278 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97f2b3b5-902e-470d-b494-84dbd0072c49 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:03.556278 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97f2b3b5-902e-470d-b494-84dbd0072c49 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:03.556278 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97f2b3b5-902e-470d-b494-84dbd0072c49 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:03.556278 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97f2b3b5-902e-470d-b494-84dbd0072c49 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:03.556600 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97f2b3b5-902e-470d-b494-84dbd0072c49 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:03.575563 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-daf803e2-6306-448c-8146-2caeddf0f8c6 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:03.576233 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-daf803e2-6306-448c-8146-2caeddf0f8c6 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:03.583100 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=2 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:42:03.585370 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-daf803e2-6306-448c-8146-2caeddf0f8c6 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:03.587482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-daf803e2-6306-448c-8146-2caeddf0f8c6 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:03.588136 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-daf803e2-6306-448c-8146-2caeddf0f8c6 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:03.589267 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-daf803e2-6306-448c-8146-2caeddf0f8c6 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:03.593733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-daf803e2-6306-448c-8146-2caeddf0f8c6 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:03.594792 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-daf803e2-6306-448c-8146-2caeddf0f8c6 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:03.695049 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-daf803e2-6306-448c-8146-2caeddf0f8c6 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:03.711279 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-daf803e2-6306-448c-8146-2caeddf0f8c6 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1130 microversion: 2.1 time: 0.140031 Aug 24 13:42:03.712626 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 231/457] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:03 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1130 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:42:03.719257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b911c54c-2367-40ff-9e81-c4ffe693b99b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:03.721934 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b911c54c-2367-40ff-9e81-c4ffe693b99b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:03.731188 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b911c54c-2367-40ff-9e81-c4ffe693b99b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:03.732282 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b911c54c-2367-40ff-9e81-c4ffe693b99b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:03.740348 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b911c54c-2367-40ff-9e81-c4ffe693b99b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:03.741523 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b911c54c-2367-40ff-9e81-c4ffe693b99b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:03.746425 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b911c54c-2367-40ff-9e81-c4ffe693b99b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:03.747762 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b911c54c-2367-40ff-9e81-c4ffe693b99b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:03.773835 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-97f2b3b5-902e-470d-b494-84dbd0072c49 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:03.784117 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-97f2b3b5-902e-470d-b494-84dbd0072c49 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:03.788008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-97f2b3b5-902e-470d-b494-84dbd0072c49 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:03.788008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-97f2b3b5-902e-470d-b494-84dbd0072c49 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.247858 Aug 24 13:42:03.788670 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 227/458] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:42:03 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:42:03.794219 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e479b097-e176-4806-b814-281cf1586283 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:03.795197 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-e479b097-e176-4806-b814-281cf1586283 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:03.804392 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e479b097-e176-4806-b814-281cf1586283 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:03.805451 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e479b097-e176-4806-b814-281cf1586283 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:03.806125 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e479b097-e176-4806-b814-281cf1586283 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:03.807253 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e479b097-e176-4806-b814-281cf1586283 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:03.808701 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e479b097-e176-4806-b814-281cf1586283 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:03.809186 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e479b097-e176-4806-b814-281cf1586283 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:03.827686 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b911c54c-2367-40ff-9e81-c4ffe693b99b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113245 Aug 24 13:42:03.833220 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 232/459] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:42:03 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:42:03.972836 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e479b097-e176-4806-b814-281cf1586283 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:03.981466 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-e479b097-e176-4806-b814-281cf1586283 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.192115 Aug 24 13:42:03.982059 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 228/460] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:03 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:04.758353 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-464cb0fa-27d6-478d-8d1c-8c30e7dbd78e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:04.771199 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-464cb0fa-27d6-478d-8d1c-8c30e7dbd78e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:04.771199 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-464cb0fa-27d6-478d-8d1c-8c30e7dbd78e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:04.771199 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-464cb0fa-27d6-478d-8d1c-8c30e7dbd78e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:04.771199 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-464cb0fa-27d6-478d-8d1c-8c30e7dbd78e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:04.771760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-464cb0fa-27d6-478d-8d1c-8c30e7dbd78e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:04.771760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-464cb0fa-27d6-478d-8d1c-8c30e7dbd78e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:04.771760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-464cb0fa-27d6-478d-8d1c-8c30e7dbd78e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:04.817057 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-55cc1784-657b-4c01-bc86-3a12acc096c4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:04.817952 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-55cc1784-657b-4c01-bc86-3a12acc096c4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:04.824950 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-55cc1784-657b-4c01-bc86-3a12acc096c4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:04.828493 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-55cc1784-657b-4c01-bc86-3a12acc096c4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:04.828493 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-55cc1784-657b-4c01-bc86-3a12acc096c4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:04.828493 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-55cc1784-657b-4c01-bc86-3a12acc096c4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:04.828493 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-55cc1784-657b-4c01-bc86-3a12acc096c4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:04.828992 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-55cc1784-657b-4c01-bc86-3a12acc096c4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:04.838399 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-464cb0fa-27d6-478d-8d1c-8c30e7dbd78e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:04.848681 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-464cb0fa-27d6-478d-8d1c-8c30e7dbd78e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1186 microversion: 2.1 time: 0.093953 Aug 24 13:42:04.849540 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 233/461] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:04 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1186 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:04.857200 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-94272999-cb49-4dc1-a659-a69bea8d7b98 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:04.858634 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-94272999-cb49-4dc1-a659-a69bea8d7b98 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:04.865627 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-94272999-cb49-4dc1-a659-a69bea8d7b98 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:04.866470 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-94272999-cb49-4dc1-a659-a69bea8d7b98 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:04.867101 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-94272999-cb49-4dc1-a659-a69bea8d7b98 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:04.868023 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-94272999-cb49-4dc1-a659-a69bea8d7b98 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:04.868604 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-94272999-cb49-4dc1-a659-a69bea8d7b98 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:04.869104 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-94272999-cb49-4dc1-a659-a69bea8d7b98 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:04.904109 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-94272999-cb49-4dc1-a659-a69bea8d7b98 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053275 Aug 24 13:42:04.904912 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 234/462] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:42:04 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:42:04.990044 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-55cc1784-657b-4c01-bc86-3a12acc096c4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:05.001376 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-55cc1784-657b-4c01-bc86-3a12acc096c4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:05.003150 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-55cc1784-657b-4c01-bc86-3a12acc096c4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:05.004419 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-55cc1784-657b-4c01-bc86-3a12acc096c4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.191392 Aug 24 13:42:05.004970 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 229/463] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:42:04 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:42:05.009890 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-3b5962e9-5f62-4e80-a8bb-7b964b1b7e3a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:05.016712 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-3b5962e9-5f62-4e80-a8bb-7b964b1b7e3a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:05.022322 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3b5962e9-5f62-4e80-a8bb-7b964b1b7e3a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:05.022857 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3b5962e9-5f62-4e80-a8bb-7b964b1b7e3a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:05.023294 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3b5962e9-5f62-4e80-a8bb-7b964b1b7e3a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:05.024257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3b5962e9-5f62-4e80-a8bb-7b964b1b7e3a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:05.024581 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3b5962e9-5f62-4e80-a8bb-7b964b1b7e3a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:05.025000 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3b5962e9-5f62-4e80-a8bb-7b964b1b7e3a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:05.212870 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-3b5962e9-5f62-4e80-a8bb-7b964b1b7e3a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:05.222534 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-3b5962e9-5f62-4e80-a8bb-7b964b1b7e3a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.222186 Aug 24 13:42:05.223133 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 235/464] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:04 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:05.343516 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-842eef63-f1d6-4a55-85f0-bf3ea9f5cfe0 req-9c54730c-90f9-470f-8d3a-4ec335951f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53bade32-e7bf-4ace-9b68-0458f257feff", "name": "network-vif-plugged", "status": "completed", "tag": "55484e25-34c8-469b-8598-d718e9469013"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:42:05.353290 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-842eef63-f1d6-4a55-85f0-bf3ea9f5cfe0 req-9c54730c-90f9-470f-8d3a-4ec335951f88 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:05.353783 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-842eef63-f1d6-4a55-85f0-bf3ea9f5cfe0 req-9c54730c-90f9-470f-8d3a-4ec335951f88 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:05.354266 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-842eef63-f1d6-4a55-85f0-bf3ea9f5cfe0 req-9c54730c-90f9-470f-8d3a-4ec335951f88 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:05.369027 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-842eef63-f1d6-4a55-85f0-bf3ea9f5cfe0 req-9c54730c-90f9-470f-8d3a-4ec335951f88 service nova] Creating event network-vif-plugged:55484e25-34c8-469b-8598-d718e9469013 for instance 53bade32-e7bf-4ace-9b68-0458f257feff on hv-cinder-77957 Aug 24 13:42:05.375727 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-842eef63-f1d6-4a55-85f0-bf3ea9f5cfe0 req-9c54730c-90f9-470f-8d3a-4ec335951f88 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037270 Aug 24 13:42:05.376436 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 230/465] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:42:05.875915 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-541e6bb7-2a5a-46bd-bec3-6f7c91f35e94 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:05.876541 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-541e6bb7-2a5a-46bd-bec3-6f7c91f35e94 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:05.883932 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-541e6bb7-2a5a-46bd-bec3-6f7c91f35e94 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:05.884473 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-541e6bb7-2a5a-46bd-bec3-6f7c91f35e94 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:05.884915 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-541e6bb7-2a5a-46bd-bec3-6f7c91f35e94 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:05.885842 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-541e6bb7-2a5a-46bd-bec3-6f7c91f35e94 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:05.886485 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-541e6bb7-2a5a-46bd-bec3-6f7c91f35e94 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:05.886707 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-541e6bb7-2a5a-46bd-bec3-6f7c91f35e94 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:05.919139 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-5a938ce8-b477-4792-ba26-4cf10192b846 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:05.921715 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-5a938ce8-b477-4792-ba26-4cf10192b846 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:05.934880 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5a938ce8-b477-4792-ba26-4cf10192b846 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:05.936075 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5a938ce8-b477-4792-ba26-4cf10192b846 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:05.936933 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5a938ce8-b477-4792-ba26-4cf10192b846 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:05.944982 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5a938ce8-b477-4792-ba26-4cf10192b846 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:05.944982 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5a938ce8-b477-4792-ba26-4cf10192b846 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:05.944982 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5a938ce8-b477-4792-ba26-4cf10192b846 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:05.964580 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-541e6bb7-2a5a-46bd-bec3-6f7c91f35e94 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:05.974872 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-541e6bb7-2a5a-46bd-bec3-6f7c91f35e94 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1194 microversion: 2.1 time: 0.102650 Aug 24 13:42:05.975467 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 236/466] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:05 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1194 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:05.977568 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=100 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:42:05.982917 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-5a938ce8-b477-4792-ba26-4cf10192b846 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069820 Aug 24 13:42:05.983491 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 231/467] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:42:05 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 13:42:06.028328 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-eac2cae0-d5e2-45eb-8833-56766d711e5d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:06.029276 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-eac2cae0-d5e2-45eb-8833-56766d711e5d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:06.035315 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-eac2cae0-d5e2-45eb-8833-56766d711e5d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:06.035789 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-eac2cae0-d5e2-45eb-8833-56766d711e5d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:06.036238 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-eac2cae0-d5e2-45eb-8833-56766d711e5d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:06.036934 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-eac2cae0-d5e2-45eb-8833-56766d711e5d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:06.037379 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-eac2cae0-d5e2-45eb-8833-56766d711e5d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:06.037795 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-eac2cae0-d5e2-45eb-8833-56766d711e5d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:06.083237 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a6b0c8a7-700f-422a-9ed2-ff003710b6e2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:06.083750 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a6b0c8a7-700f-422a-9ed2-ff003710b6e2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:06.091312 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a6b0c8a7-700f-422a-9ed2-ff003710b6e2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:06.091813 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a6b0c8a7-700f-422a-9ed2-ff003710b6e2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:06.092272 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a6b0c8a7-700f-422a-9ed2-ff003710b6e2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:06.092984 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a6b0c8a7-700f-422a-9ed2-ff003710b6e2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:06.093434 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a6b0c8a7-700f-422a-9ed2-ff003710b6e2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:06.093859 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a6b0c8a7-700f-422a-9ed2-ff003710b6e2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:06.123468 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a6b0c8a7-700f-422a-9ed2-ff003710b6e2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Going to try to terminate instance {{(pid=133014) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 13:42:06.218448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-eac2cae0-d5e2-45eb-8833-56766d711e5d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:06.226122 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-eac2cae0-d5e2-45eb-8833-56766d711e5d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:06.227663 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-eac2cae0-d5e2-45eb-8833-56766d711e5d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:06.228907 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-eac2cae0-d5e2-45eb-8833-56766d711e5d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.205682 Aug 24 13:42:06.230275 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 237/468] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:42:06 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:42:06.258016 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-f9b50761-8596-46a2-b498-dda5a1284a2e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:06.258641 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-f9b50761-8596-46a2-b498-dda5a1284a2e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:06.268912 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f9b50761-8596-46a2-b498-dda5a1284a2e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:06.269758 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f9b50761-8596-46a2-b498-dda5a1284a2e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:06.270555 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f9b50761-8596-46a2-b498-dda5a1284a2e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:06.271838 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f9b50761-8596-46a2-b498-dda5a1284a2e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:06.272710 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f9b50761-8596-46a2-b498-dda5a1284a2e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:06.273501 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f9b50761-8596-46a2-b498-dda5a1284a2e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:06.436555 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f9b50761-8596-46a2-b498-dda5a1284a2e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:06.444997 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-f9b50761-8596-46a2-b498-dda5a1284a2e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.190795 Aug 24 13:42:06.445594 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 238/469] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:06 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:42:06.518133 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a6b0c8a7-700f-422a-9ed2-ff003710b6e2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 204 len: 0 microversion: 2.1 time: 0.438957 Aug 24 13:42:06.519117 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 232/470] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:42:06 2022] DELETE /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 13:42:06.529116 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-34ffecdc-4467-48ff-9986-11c4a87eb36c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:06.529752 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-34ffecdc-4467-48ff-9986-11c4a87eb36c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:06.536411 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-34ffecdc-4467-48ff-9986-11c4a87eb36c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:06.536954 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-34ffecdc-4467-48ff-9986-11c4a87eb36c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:06.537348 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-34ffecdc-4467-48ff-9986-11c4a87eb36c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:06.540102 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-34ffecdc-4467-48ff-9986-11c4a87eb36c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:06.540102 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-34ffecdc-4467-48ff-9986-11c4a87eb36c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:06.540102 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-34ffecdc-4467-48ff-9986-11c4a87eb36c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:06.681605 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-34ffecdc-4467-48ff-9986-11c4a87eb36c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:06.690914 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-34ffecdc-4467-48ff-9986-11c4a87eb36c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1681 microversion: 2.1 time: 0.166954 Aug 24 13:42:06.691509 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 239/471] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:06 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:06.999418 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e21bc1bd-0d61-4065-b963-74914985af60 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:07.000108 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-e21bc1bd-0d61-4065-b963-74914985af60 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:07.007545 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e21bc1bd-0d61-4065-b963-74914985af60 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:07.008099 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e21bc1bd-0d61-4065-b963-74914985af60 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:07.008626 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e21bc1bd-0d61-4065-b963-74914985af60 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:07.009484 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e21bc1bd-0d61-4065-b963-74914985af60 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:07.009996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e21bc1bd-0d61-4065-b963-74914985af60 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:07.011122 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e21bc1bd-0d61-4065-b963-74914985af60 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:07.077359 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e21bc1bd-0d61-4065-b963-74914985af60 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:07.085205 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-e21bc1bd-0d61-4065-b963-74914985af60 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1194 microversion: 2.1 time: 0.091845 Aug 24 13:42:07.085772 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 233/472] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:06 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1194 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:07.254326 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-0c512941-6da6-4946-8b2f-d2b5c7c79c33 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:07.254880 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-0c512941-6da6-4946-8b2f-d2b5c7c79c33 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:07.262640 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0c512941-6da6-4946-8b2f-d2b5c7c79c33 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:07.263126 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0c512941-6da6-4946-8b2f-d2b5c7c79c33 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:07.263568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0c512941-6da6-4946-8b2f-d2b5c7c79c33 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:07.264304 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0c512941-6da6-4946-8b2f-d2b5c7c79c33 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:07.264753 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0c512941-6da6-4946-8b2f-d2b5c7c79c33 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:07.265171 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0c512941-6da6-4946-8b2f-d2b5c7c79c33 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:07.397036 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-0c512941-6da6-4946-8b2f-d2b5c7c79c33 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:07.406770 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-0c512941-6da6-4946-8b2f-d2b5c7c79c33 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:07.408412 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-0c512941-6da6-4946-8b2f-d2b5c7c79c33 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:07.409572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-0c512941-6da6-4946-8b2f-d2b5c7c79c33 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.159575 Aug 24 13:42:07.410138 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 240/473] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:42:07 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:42:07.481279 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-d94603dc-a75c-419d-a250-2f3bb66bf93d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:07.481882 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-d94603dc-a75c-419d-a250-2f3bb66bf93d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:07.488047 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d94603dc-a75c-419d-a250-2f3bb66bf93d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:07.488564 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d94603dc-a75c-419d-a250-2f3bb66bf93d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:07.488996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d94603dc-a75c-419d-a250-2f3bb66bf93d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:07.489682 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d94603dc-a75c-419d-a250-2f3bb66bf93d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:07.490165 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d94603dc-a75c-419d-a250-2f3bb66bf93d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:07.490634 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d94603dc-a75c-419d-a250-2f3bb66bf93d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:07.630312 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-d94603dc-a75c-419d-a250-2f3bb66bf93d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:07.638854 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-d94603dc-a75c-419d-a250-2f3bb66bf93d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.162236 Aug 24 13:42:07.639442 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 234/474] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:07 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:07.713073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-6c7a0811-65c7-4452-9b5c-5d088a2bf681 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:07.714688 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-6c7a0811-65c7-4452-9b5c-5d088a2bf681 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:07.721080 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6c7a0811-65c7-4452-9b5c-5d088a2bf681 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:07.721596 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6c7a0811-65c7-4452-9b5c-5d088a2bf681 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:07.722035 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6c7a0811-65c7-4452-9b5c-5d088a2bf681 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:07.722732 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6c7a0811-65c7-4452-9b5c-5d088a2bf681 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:07.723184 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6c7a0811-65c7-4452-9b5c-5d088a2bf681 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:07.723609 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6c7a0811-65c7-4452-9b5c-5d088a2bf681 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:07.727799 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=100 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:42:07.875137 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-6c7a0811-65c7-4452-9b5c-5d088a2bf681 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:07.882832 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-6c7a0811-65c7-4452-9b5c-5d088a2bf681 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1681 microversion: 2.1 time: 0.173714 Aug 24 13:42:07.883402 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 241/475] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:07 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:08.106130 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-5f479a4d-84e8-416c-9011-82b032ec5119 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:08.106778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-5f479a4d-84e8-416c-9011-82b032ec5119 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:08.113631 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5f479a4d-84e8-416c-9011-82b032ec5119 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:08.114119 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5f479a4d-84e8-416c-9011-82b032ec5119 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:08.114555 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5f479a4d-84e8-416c-9011-82b032ec5119 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:08.115249 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5f479a4d-84e8-416c-9011-82b032ec5119 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:08.115706 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5f479a4d-84e8-416c-9011-82b032ec5119 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:08.116130 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5f479a4d-84e8-416c-9011-82b032ec5119 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:08.180060 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-5f479a4d-84e8-416c-9011-82b032ec5119 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:08.188156 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-5f479a4d-84e8-416c-9011-82b032ec5119 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1194 microversion: 2.1 time: 0.086293 Aug 24 13:42:08.188745 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 235/476] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:08 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:08.434695 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-4b94dbbb-258e-4d62-91e1-30e51a772310 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:08.435473 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-4b94dbbb-258e-4d62-91e1-30e51a772310 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:08.442148 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4b94dbbb-258e-4d62-91e1-30e51a772310 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:08.442630 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4b94dbbb-258e-4d62-91e1-30e51a772310 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:08.443064 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4b94dbbb-258e-4d62-91e1-30e51a772310 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:08.443770 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4b94dbbb-258e-4d62-91e1-30e51a772310 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:08.444250 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4b94dbbb-258e-4d62-91e1-30e51a772310 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:08.444676 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4b94dbbb-258e-4d62-91e1-30e51a772310 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:08.586407 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4b94dbbb-258e-4d62-91e1-30e51a772310 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:08.596020 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4b94dbbb-258e-4d62-91e1-30e51a772310 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:08.597621 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4b94dbbb-258e-4d62-91e1-30e51a772310 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:08.598790 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-4b94dbbb-258e-4d62-91e1-30e51a772310 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.169608 Aug 24 13:42:08.599359 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 242/477] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:42:08 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:42:08.660425 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-0956835b-c4c6-4fea-8680-cf00f76623e3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:08.661029 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-0956835b-c4c6-4fea-8680-cf00f76623e3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:08.667287 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0956835b-c4c6-4fea-8680-cf00f76623e3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:08.667985 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0956835b-c4c6-4fea-8680-cf00f76623e3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:08.668445 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0956835b-c4c6-4fea-8680-cf00f76623e3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:08.669138 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0956835b-c4c6-4fea-8680-cf00f76623e3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:08.669589 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0956835b-c4c6-4fea-8680-cf00f76623e3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:08.670007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0956835b-c4c6-4fea-8680-cf00f76623e3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:08.805639 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0956835b-c4c6-4fea-8680-cf00f76623e3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:08.814195 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-0956835b-c4c6-4fea-8680-cf00f76623e3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.157780 Aug 24 13:42:08.814777 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 236/478] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:08 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:08.905549 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-37e838f1-32fd-431d-a8a3-e8a744fd9284 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:08.906312 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-37e838f1-32fd-431d-a8a3-e8a744fd9284 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:08.912328 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-37e838f1-32fd-431d-a8a3-e8a744fd9284 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:08.912804 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-37e838f1-32fd-431d-a8a3-e8a744fd9284 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:08.913235 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-37e838f1-32fd-431d-a8a3-e8a744fd9284 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:08.913922 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-37e838f1-32fd-431d-a8a3-e8a744fd9284 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:08.914376 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-37e838f1-32fd-431d-a8a3-e8a744fd9284 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:08.914798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-37e838f1-32fd-431d-a8a3-e8a744fd9284 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:09.045280 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-37e838f1-32fd-431d-a8a3-e8a744fd9284 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:09.053379 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-37e838f1-32fd-431d-a8a3-e8a744fd9284 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1681 microversion: 2.1 time: 0.152958 Aug 24 13:42:09.053961 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 243/479] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:08 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:09.211062 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-ee2c65ab-13ec-4bb0-97d9-3ef41b7e1526 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:09.211775 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-ee2c65ab-13ec-4bb0-97d9-3ef41b7e1526 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:09.218464 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ee2c65ab-13ec-4bb0-97d9-3ef41b7e1526 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:09.218958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ee2c65ab-13ec-4bb0-97d9-3ef41b7e1526 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:09.219384 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ee2c65ab-13ec-4bb0-97d9-3ef41b7e1526 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:09.220073 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ee2c65ab-13ec-4bb0-97d9-3ef41b7e1526 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:09.220559 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ee2c65ab-13ec-4bb0-97d9-3ef41b7e1526 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:09.220994 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ee2c65ab-13ec-4bb0-97d9-3ef41b7e1526 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:09.290039 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-ee2c65ab-13ec-4bb0-97d9-3ef41b7e1526 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:09.298678 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-ee2c65ab-13ec-4bb0-97d9-3ef41b7e1526 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1204 microversion: 2.1 time: 0.091767 Aug 24 13:42:09.299253 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 237/480] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:09 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1204 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:09.622204 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-8d568942-af99-4c81-ad1c-a505b80bb360 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:09.622782 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-8d568942-af99-4c81-ad1c-a505b80bb360 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:09.629610 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8d568942-af99-4c81-ad1c-a505b80bb360 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:09.630099 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8d568942-af99-4c81-ad1c-a505b80bb360 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:09.630560 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8d568942-af99-4c81-ad1c-a505b80bb360 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:09.631236 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8d568942-af99-4c81-ad1c-a505b80bb360 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:09.633576 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8d568942-af99-4c81-ad1c-a505b80bb360 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:09.633576 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8d568942-af99-4c81-ad1c-a505b80bb360 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:09.770641 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-8d568942-af99-4c81-ad1c-a505b80bb360 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:09.782491 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-8d568942-af99-4c81-ad1c-a505b80bb360 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:09.787702 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-8d568942-af99-4c81-ad1c-a505b80bb360 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:09.787702 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-8d568942-af99-4c81-ad1c-a505b80bb360 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.168008 Aug 24 13:42:09.787702 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 244/481] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:42:09 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:42:09.842611 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-efcc7115-b536-44d0-9e73-201e16b1eb69 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:09.843240 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-efcc7115-b536-44d0-9e73-201e16b1eb69 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:09.849878 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-efcc7115-b536-44d0-9e73-201e16b1eb69 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:09.850431 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-efcc7115-b536-44d0-9e73-201e16b1eb69 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:09.850814 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-efcc7115-b536-44d0-9e73-201e16b1eb69 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:09.851493 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-efcc7115-b536-44d0-9e73-201e16b1eb69 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:09.852014 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-efcc7115-b536-44d0-9e73-201e16b1eb69 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:09.852536 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-efcc7115-b536-44d0-9e73-201e16b1eb69 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:10.014369 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-efcc7115-b536-44d0-9e73-201e16b1eb69 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:10.023988 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-efcc7115-b536-44d0-9e73-201e16b1eb69 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1502 microversion: 2.1 time: 0.186721 Aug 24 13:42:10.024621 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 238/482] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:09 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1502 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:10.049369 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-12439201-2ee7-4650-bd90-f75fafdf2577 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2251c463-41a3-4852-be76-54e3f28f3191"}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:42:10.051822 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-12439201-2ee7-4650-bd90-f75fafdf2577 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:10.058756 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-12439201-2ee7-4650-bd90-f75fafdf2577 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:10.059245 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-12439201-2ee7-4650-bd90-f75fafdf2577 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:10.060636 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-12439201-2ee7-4650-bd90-f75fafdf2577 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:10.060636 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-12439201-2ee7-4650-bd90-f75fafdf2577 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:10.061279 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-12439201-2ee7-4650-bd90-f75fafdf2577 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:10.061827 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-12439201-2ee7-4650-bd90-f75fafdf2577 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:10.075312 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-663ff818-6df6-4457-8e3c-2b49a02607a6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:10.075943 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-663ff818-6df6-4457-8e3c-2b49a02607a6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:10.082362 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-663ff818-6df6-4457-8e3c-2b49a02607a6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:10.082866 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-663ff818-6df6-4457-8e3c-2b49a02607a6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:10.083310 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-663ff818-6df6-4457-8e3c-2b49a02607a6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:10.084039 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-663ff818-6df6-4457-8e3c-2b49a02607a6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:10.084532 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-663ff818-6df6-4457-8e3c-2b49a02607a6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:10.084968 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-663ff818-6df6-4457-8e3c-2b49a02607a6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:10.092667 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.wsgi [None req-12439201-2ee7-4650-bd90-f75fafdf2577 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] HTTP exception thrown: Cannot 'attach_volume' instance 08ba9691-685f-444a-9c86-9ac1562acbf0 while it is in vm_state rescued Aug 24 13:42:10.094448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-12439201-2ee7-4650-bd90-f75fafdf2577 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Request method failure captured: Aug 24 13:42:10.094448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: POST /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0/os-volume_attachments HTTP/1.1 Aug 24 13:42:10.094448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:42:10.094448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:42:10.094448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:42:10.094448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 74 Aug 24 13:42:10.094448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:42:10.094448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:42:10.094448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:42:10.094448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:42:10.094448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBio-vt113GyIGAINLSzOWx94ASYzerXaZEv5YREo1TToDpvzKyjcRowpvDgdJaKCc7yo4wyulaPEgIjpHjojWeA6p7mHKzAe5aa4pnmTJ73FsHansramwsQRGoDLdIydz44BXnhPycna7G2wYedVilx-YfOCQ3CHOnMCEUjDFP26dAs Aug 24 13:42:10.094448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:42:10.094448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:42:10.094448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:42:10.094448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:42:10.094448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:42:10.094448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:42:10.094448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: 127e5da55b164ce68568c153fee58baf Aug 24 13:42:10.094448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1606015574 Aug 24 13:42:10.094448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:42:10.094448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:42:10.097256 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/127e5da55b164ce68568c153fee58baf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/127e5da55b164ce68568c153fee58baf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_127e5da55b164ce68568c153fee58baf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/127e5da55b164ce68568c153fee58baf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:42:10.097256 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1606015574 Aug 24 13:42:10.097256 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: 127e5da55b164ce68568c153fee58baf Aug 24 13:42:10.097256 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1606015574 Aug 24 13:42:10.097256 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-ServerRescueNegativeTestJSON-1606015574-project Aug 24 13:42:10.097256 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:42:10.097256 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:42:10.097256 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: adb792e7246d42dface4aa52899a0ffc Aug 24 13:42:10.097256 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1606015574-project Aug 24 13:42:10.097256 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Aug 24 13:42:10.097256 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {"volumeAttachment": {"volumeId": "2251c463-41a3-4852-be76-54e3f28f3191"}} Aug 24 13:42:10.097256 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: > Aug 24 13:42:10.099179 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Cannot 'attach_volume' instance 08ba9691-685f-444a-9c86-9ac1562acbf0 while it is in vm_state rescued Aug 24 13:42:10.099179 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'server_id': '08ba9691-685f-444a-9c86-9ac1562acbf0', 'body': {'volumeAttachment': {'volumeId': '2251c463-41a3-4852-be76-54e3f28f3191'}}} Aug 24 13:42:10.099179 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:42:10.099179 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:42:10.099179 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 13:42:10.099179 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 13:42:10.099179 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 13:42:10.099179 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 13:42:10.099179 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 13:42:10.099179 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 13:42:10.099179 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 08ba9691-685f-444a-9c86-9ac1562acbf0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 13:42:10.099179 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:42:10.099179 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:42:10.099179 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:42:10.099179 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:42:10.099179 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:42:10.099179 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:42:10.099179 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:42:10.099179 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:42:10.101746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:42:10.101746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:42:10.101746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 13:42:10.101746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 13:42:10.101746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 13:42:10.101746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 13:42:10.101746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 13:42:10.101746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 13:42:10.101746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 13:42:10.101746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 13:42:10.101746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 13:42:10.101746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 13:42:10.101746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 08ba9691-685f-444a-9c86-9ac1562acbf0 while it is in vm_state rescued Aug 24 13:42:10.101746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:42:10.101746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:42:10.101746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:42:10.101746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:42:10.101746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:42:10.101746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:42:10.112122 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:42:10.112122 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:42:10.112122 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 08ba9691-685f-444a-9c86-9ac1562acbf0 while it is in vm_state rescued Aug 24 13:42:10.112122 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:42:10.112122 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-12439201-2ee7-4650-bd90-f75fafdf2577 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Returning 409 to user: Cannot 'attach_volume' instance 08ba9691-685f-444a-9c86-9ac1562acbf0 while it is in vm_state rescued {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:42:10.112122 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-12439201-2ee7-4650-bd90-f75fafdf2577 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "POST /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050513 Aug 24 13:42:10.112122 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 245/483] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 13:42:10 2022] POST /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 13:42:10.112122 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-3694c9cd-38f9-424d-babc-711bd5eda8b5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:42:10.114743 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-3694c9cd-38f9-424d-babc-711bd5eda8b5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:10.114743 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3694c9cd-38f9-424d-babc-711bd5eda8b5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:10.114743 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3694c9cd-38f9-424d-babc-711bd5eda8b5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:10.114743 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3694c9cd-38f9-424d-babc-711bd5eda8b5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:10.115388 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3694c9cd-38f9-424d-babc-711bd5eda8b5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:10.115388 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3694c9cd-38f9-424d-babc-711bd5eda8b5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:10.115606 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3694c9cd-38f9-424d-babc-711bd5eda8b5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:10.236090 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-663ff818-6df6-4457-8e3c-2b49a02607a6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:10.243871 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-663ff818-6df6-4457-8e3c-2b49a02607a6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1681 microversion: 2.1 time: 0.173098 Aug 24 13:42:10.244589 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 239/484] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:10 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:42:10.324301 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-8680dfe0-9e45-4c19-a737-2e6f0551c4dd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:10.325042 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-8680dfe0-9e45-4c19-a737-2e6f0551c4dd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:10.327108 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:42:10.331901 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8680dfe0-9e45-4c19-a737-2e6f0551c4dd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:10.332764 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8680dfe0-9e45-4c19-a737-2e6f0551c4dd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:10.332872 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8680dfe0-9e45-4c19-a737-2e6f0551c4dd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:10.333565 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8680dfe0-9e45-4c19-a737-2e6f0551c4dd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:10.334027 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8680dfe0-9e45-4c19-a737-2e6f0551c4dd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:10.334452 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8680dfe0-9e45-4c19-a737-2e6f0551c4dd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:10.407331 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-3694c9cd-38f9-424d-babc-711bd5eda8b5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "POST /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0/action" status: 202 len: 0 microversion: 2.1 time: 0.305812 Aug 24 13:42:10.408439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-8680dfe0-9e45-4c19-a737-2e6f0551c4dd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:10.408565 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 246/485] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 13:42:10 2022] POST /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:42:10.416205 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-8680dfe0-9e45-4c19-a737-2e6f0551c4dd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1204 microversion: 2.1 time: 0.097115 Aug 24 13:42:10.417828 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-4e0c2338-ba19-499f-b1a7-7a3a67e6e008 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:10.418584 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-4e0c2338-ba19-499f-b1a7-7a3a67e6e008 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:10.420522 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 240/486] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:10 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1204 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:10.421271 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:42:10.436203 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4e0c2338-ba19-499f-b1a7-7a3a67e6e008 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:10.436203 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4e0c2338-ba19-499f-b1a7-7a3a67e6e008 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:10.436552 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4e0c2338-ba19-499f-b1a7-7a3a67e6e008 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:10.437259 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4e0c2338-ba19-499f-b1a7-7a3a67e6e008 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:10.437712 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4e0c2338-ba19-499f-b1a7-7a3a67e6e008 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:10.438137 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4e0c2338-ba19-499f-b1a7-7a3a67e6e008 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:10.582953 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4e0c2338-ba19-499f-b1a7-7a3a67e6e008 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:10.591253 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-4e0c2338-ba19-499f-b1a7-7a3a67e6e008 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1510 microversion: 2.1 time: 0.178798 Aug 24 13:42:10.591831 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 247/487] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:10 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:10.811604 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-8247f040-dba9-45b3-975c-4d678a1dcc8e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:10.812228 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-8247f040-dba9-45b3-975c-4d678a1dcc8e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:10.818421 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8247f040-dba9-45b3-975c-4d678a1dcc8e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:10.818903 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8247f040-dba9-45b3-975c-4d678a1dcc8e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:10.819334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8247f040-dba9-45b3-975c-4d678a1dcc8e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:10.820018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8247f040-dba9-45b3-975c-4d678a1dcc8e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:10.820498 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8247f040-dba9-45b3-975c-4d678a1dcc8e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:10.821252 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8247f040-dba9-45b3-975c-4d678a1dcc8e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:10.957817 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-8247f040-dba9-45b3-975c-4d678a1dcc8e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:10.968281 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-8247f040-dba9-45b3-975c-4d678a1dcc8e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:10.969810 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-8247f040-dba9-45b3-975c-4d678a1dcc8e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:10.971018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-8247f040-dba9-45b3-975c-4d678a1dcc8e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.164385 Aug 24 13:42:10.971693 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 241/488] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:42:10 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:42:11.266962 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-e05c9395-b6e3-4b2a-85ec-80931450f795 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:11.268382 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-e05c9395-b6e3-4b2a-85ec-80931450f795 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:11.283276 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e05c9395-b6e3-4b2a-85ec-80931450f795 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:11.284075 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e05c9395-b6e3-4b2a-85ec-80931450f795 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:11.284850 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e05c9395-b6e3-4b2a-85ec-80931450f795 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:11.285590 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e05c9395-b6e3-4b2a-85ec-80931450f795 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:11.286045 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e05c9395-b6e3-4b2a-85ec-80931450f795 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:11.286497 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e05c9395-b6e3-4b2a-85ec-80931450f795 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:11.438689 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-df80296c-3e82-4c15-9258-0bd83aa09754 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:11.440004 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-df80296c-3e82-4c15-9258-0bd83aa09754 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:11.446592 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-df80296c-3e82-4c15-9258-0bd83aa09754 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:11.447208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-df80296c-3e82-4c15-9258-0bd83aa09754 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:11.447819 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-df80296c-3e82-4c15-9258-0bd83aa09754 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:11.449150 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-df80296c-3e82-4c15-9258-0bd83aa09754 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:11.450058 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-df80296c-3e82-4c15-9258-0bd83aa09754 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:11.450571 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-df80296c-3e82-4c15-9258-0bd83aa09754 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:11.559505 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-df80296c-3e82-4c15-9258-0bd83aa09754 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:11.570659 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-df80296c-3e82-4c15-9258-0bd83aa09754 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1204 microversion: 2.1 time: 0.136673 Aug 24 13:42:11.572309 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 242/489] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:11 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1204 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:11.613191 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-dde8bc0c-5891-433f-807d-fef6980997a0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:11.614110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-dde8bc0c-5891-433f-807d-fef6980997a0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:11.621428 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dde8bc0c-5891-433f-807d-fef6980997a0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:11.621922 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dde8bc0c-5891-433f-807d-fef6980997a0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:11.622372 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dde8bc0c-5891-433f-807d-fef6980997a0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:11.623082 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dde8bc0c-5891-433f-807d-fef6980997a0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:11.623537 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dde8bc0c-5891-433f-807d-fef6980997a0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:11.623979 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dde8bc0c-5891-433f-807d-fef6980997a0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:11.665470 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-e05c9395-b6e3-4b2a-85ec-80931450f795 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:11.673701 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-e05c9395-b6e3-4b2a-85ec-80931450f795 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1681 microversion: 2.1 time: 0.411015 Aug 24 13:42:11.674433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 248/490] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:11 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1681 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:42:11.917889 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-dde8bc0c-5891-433f-807d-fef6980997a0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:11.929328 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-dde8bc0c-5891-433f-807d-fef6980997a0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1510 microversion: 2.1 time: 0.319770 Aug 24 13:42:11.930208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 243/491] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:11 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1510 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:11.996275 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-4caba684-a853-4a48-947f-771509d07b1f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:11.996964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-4caba684-a853-4a48-947f-771509d07b1f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:12.003067 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4caba684-a853-4a48-947f-771509d07b1f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:12.003550 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4caba684-a853-4a48-947f-771509d07b1f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:12.003980 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4caba684-a853-4a48-947f-771509d07b1f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:12.004686 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4caba684-a853-4a48-947f-771509d07b1f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:12.005167 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4caba684-a853-4a48-947f-771509d07b1f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:12.005590 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4caba684-a853-4a48-947f-771509d07b1f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:12.298572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4caba684-a853-4a48-947f-771509d07b1f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:12.309779 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4caba684-a853-4a48-947f-771509d07b1f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:12.311756 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4caba684-a853-4a48-947f-771509d07b1f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:12.312952 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-4caba684-a853-4a48-947f-771509d07b1f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.321510 Aug 24 13:42:12.314599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 249/492] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:42:11 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:42:12.596617 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-6d5c44ba-7f64-40db-973c-dd718d0014de tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:12.597232 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-6d5c44ba-7f64-40db-973c-dd718d0014de tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:12.604482 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6d5c44ba-7f64-40db-973c-dd718d0014de tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:12.605236 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6d5c44ba-7f64-40db-973c-dd718d0014de tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:12.605702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6d5c44ba-7f64-40db-973c-dd718d0014de tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:12.606500 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6d5c44ba-7f64-40db-973c-dd718d0014de tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:12.607179 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6d5c44ba-7f64-40db-973c-dd718d0014de tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:12.608009 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6d5c44ba-7f64-40db-973c-dd718d0014de tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:12.699961 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b3ffd393-176d-4b31-aef1-58274c714092 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:12.701229 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b3ffd393-176d-4b31-aef1-58274c714092 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:12.710140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b3ffd393-176d-4b31-aef1-58274c714092 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:12.711450 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b3ffd393-176d-4b31-aef1-58274c714092 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:12.715617 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b3ffd393-176d-4b31-aef1-58274c714092 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:12.717224 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b3ffd393-176d-4b31-aef1-58274c714092 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:12.718223 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b3ffd393-176d-4b31-aef1-58274c714092 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:12.718328 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b3ffd393-176d-4b31-aef1-58274c714092 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:13.107626 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-6d5c44ba-7f64-40db-973c-dd718d0014de tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:13.113178 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b3ffd393-176d-4b31-aef1-58274c714092 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:13.121767 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-6d5c44ba-7f64-40db-973c-dd718d0014de tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1272 microversion: 2.1 time: 0.529145 Aug 24 13:42:13.132253 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b3ffd393-176d-4b31-aef1-58274c714092 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1614 microversion: 2.1 time: 0.431576 Aug 24 13:42:13.132253 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 250/493] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:12 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1614 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:42:13.133644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 244/494] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:12 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1272 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:13.144068 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-5803e77f-f49b-4357-989f-7abcd4c42596 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:13.144838 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-5803e77f-f49b-4357-989f-7abcd4c42596 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:13.147808 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-72a35cf3-67a8-4944-9f72-b513ee7e239d req-b97e840b-2053-45cb-af99-493a9d41102f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ad88e6d-b2b8-4049-b987-94022767fa67", "name": "network-vif-deleted", "tag": "0723b1a9-9fdc-4151-b023-7ddb25fe09e0"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:42:13.151284 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5803e77f-f49b-4357-989f-7abcd4c42596 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:13.153321 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5803e77f-f49b-4357-989f-7abcd4c42596 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:13.154057 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5803e77f-f49b-4357-989f-7abcd4c42596 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:13.154873 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5803e77f-f49b-4357-989f-7abcd4c42596 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:13.155503 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5803e77f-f49b-4357-989f-7abcd4c42596 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:13.156110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5803e77f-f49b-4357-989f-7abcd4c42596 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:13.158883 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-72a35cf3-67a8-4944-9f72-b513ee7e239d req-b97e840b-2053-45cb-af99-493a9d41102f service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:13.159287 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-72a35cf3-67a8-4944-9f72-b513ee7e239d req-b97e840b-2053-45cb-af99-493a9d41102f service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:13.159814 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-72a35cf3-67a8-4944-9f72-b513ee7e239d req-b97e840b-2053-45cb-af99-493a9d41102f service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:13.173925 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-72a35cf3-67a8-4944-9f72-b513ee7e239d req-b97e840b-2053-45cb-af99-493a9d41102f service nova] Creating event network-vif-deleted:0723b1a9-9fdc-4151-b023-7ddb25fe09e0 for instance 3ad88e6d-b2b8-4049-b987-94022767fa67 on hv-cinder-77957 Aug 24 13:42:13.180437 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-72a35cf3-67a8-4944-9f72-b513ee7e239d req-b97e840b-2053-45cb-af99-493a9d41102f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038394 Aug 24 13:42:13.181899 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 251/495] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:42:13.343183 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b02820c6-b66f-434a-8ebf-51bfc4f1e8d6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:13.344866 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b02820c6-b66f-434a-8ebf-51bfc4f1e8d6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:13.353857 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b02820c6-b66f-434a-8ebf-51bfc4f1e8d6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:13.359848 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b02820c6-b66f-434a-8ebf-51bfc4f1e8d6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:13.360876 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b02820c6-b66f-434a-8ebf-51bfc4f1e8d6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:13.361869 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b02820c6-b66f-434a-8ebf-51bfc4f1e8d6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:13.362584 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b02820c6-b66f-434a-8ebf-51bfc4f1e8d6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:13.363404 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b02820c6-b66f-434a-8ebf-51bfc4f1e8d6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:13.525806 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-5803e77f-f49b-4357-989f-7abcd4c42596 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:13.556953 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-5803e77f-f49b-4357-989f-7abcd4c42596 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1510 microversion: 2.1 time: 0.421692 Aug 24 13:42:13.558646 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 245/496] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:13 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1510 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:13.652729 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b02820c6-b66f-434a-8ebf-51bfc4f1e8d6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:13.664424 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b02820c6-b66f-434a-8ebf-51bfc4f1e8d6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:13.666014 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b02820c6-b66f-434a-8ebf-51bfc4f1e8d6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:13.668606 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b02820c6-b66f-434a-8ebf-51bfc4f1e8d6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.331577 Aug 24 13:42:13.677342 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 252/497] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:42:13 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:42:14.082007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-53ab6560-74fb-4612-bf5a-6b0139c1fe80 req-7ff440a1-6983-4266-88e2-46650b2a1746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1118fb04-6744-4b7c-b639-0081073ee53a", "tag": "579a6bec-e4ab-438a-a263-2fafa0fe42bc"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:42:14.109106 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-53ab6560-74fb-4612-bf5a-6b0139c1fe80 req-7ff440a1-6983-4266-88e2-46650b2a1746 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:14.109997 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-53ab6560-74fb-4612-bf5a-6b0139c1fe80 req-7ff440a1-6983-4266-88e2-46650b2a1746 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:14.111201 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-53ab6560-74fb-4612-bf5a-6b0139c1fe80 req-7ff440a1-6983-4266-88e2-46650b2a1746 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:14.139286 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-53ab6560-74fb-4612-bf5a-6b0139c1fe80 req-7ff440a1-6983-4266-88e2-46650b2a1746 service nova] Creating event network-changed:579a6bec-e4ab-438a-a263-2fafa0fe42bc for instance 1118fb04-6744-4b7c-b639-0081073ee53a on hv-cinder-77957 Aug 24 13:42:14.145076 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-53ab6560-74fb-4612-bf5a-6b0139c1fe80 req-7ff440a1-6983-4266-88e2-46650b2a1746 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071756 Aug 24 13:42:14.147290 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 246/498] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:42:14.150090 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b209e01b-1223-40c0-83ab-42d9dc4b0a57 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:14.151594 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b209e01b-1223-40c0-83ab-42d9dc4b0a57 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:14.154449 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-807e8db9-611a-41c9-8fc3-6ca2aba77ef4 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:14.155749 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-807e8db9-611a-41c9-8fc3-6ca2aba77ef4 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:14.159574 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b209e01b-1223-40c0-83ab-42d9dc4b0a57 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:14.160062 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b209e01b-1223-40c0-83ab-42d9dc4b0a57 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:14.160733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b209e01b-1223-40c0-83ab-42d9dc4b0a57 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:14.162322 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b209e01b-1223-40c0-83ab-42d9dc4b0a57 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:14.162322 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b209e01b-1223-40c0-83ab-42d9dc4b0a57 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:14.162487 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-807e8db9-611a-41c9-8fc3-6ca2aba77ef4 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:14.162567 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b209e01b-1223-40c0-83ab-42d9dc4b0a57 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:14.162665 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-807e8db9-611a-41c9-8fc3-6ca2aba77ef4 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:14.162938 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-807e8db9-611a-41c9-8fc3-6ca2aba77ef4 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:14.164415 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-807e8db9-611a-41c9-8fc3-6ca2aba77ef4 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:14.165036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-807e8db9-611a-41c9-8fc3-6ca2aba77ef4 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:14.165625 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-807e8db9-611a-41c9-8fc3-6ca2aba77ef4 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:14.193001 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:42:14.199397 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b209e01b-1223-40c0-83ab-42d9dc4b0a57 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:14.200705 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b209e01b-1223-40c0-83ab-42d9dc4b0a57 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:14.200705 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b209e01b-1223-40c0-83ab-42d9dc4b0a57 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:14.201127 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.objects.instance [None req-b209e01b-1223-40c0-83ab-42d9dc4b0a57 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lazy-loading 'fault' on Instance uuid 3ad88e6d-b2b8-4049-b987-94022767fa67 {{(pid=133015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:42:14.298239 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b209e01b-1223-40c0-83ab-42d9dc4b0a57 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:14.307056 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b209e01b-1223-40c0-83ab-42d9dc4b0a57 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1331 microversion: 2.1 time: 0.163395 Aug 24 13:42:14.308678 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 253/499] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:14 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1331 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:14.387288 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-807e8db9-611a-41c9-8fc3-6ca2aba77ef4 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:14.400123 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-807e8db9-611a-41c9-8fc3-6ca2aba77ef4 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1260 microversion: 2.1 time: 0.250511 Aug 24 13:42:14.401150 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 247/500] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:14 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1260 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:14.579799 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b66c89b7-5ecc-4db9-a36b-2a0b109de603 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:14.580438 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b66c89b7-5ecc-4db9-a36b-2a0b109de603 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:14.587141 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b66c89b7-5ecc-4db9-a36b-2a0b109de603 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:14.587666 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b66c89b7-5ecc-4db9-a36b-2a0b109de603 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:14.588101 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b66c89b7-5ecc-4db9-a36b-2a0b109de603 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:14.589377 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b66c89b7-5ecc-4db9-a36b-2a0b109de603 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:14.589927 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b66c89b7-5ecc-4db9-a36b-2a0b109de603 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:14.590352 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b66c89b7-5ecc-4db9-a36b-2a0b109de603 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:14.693392 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-45fb9e64-706e-4f28-9452-3aa4623cb604 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:14.694183 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-45fb9e64-706e-4f28-9452-3aa4623cb604 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:14.701372 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-45fb9e64-706e-4f28-9452-3aa4623cb604 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:14.702129 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-45fb9e64-706e-4f28-9452-3aa4623cb604 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:14.702680 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-45fb9e64-706e-4f28-9452-3aa4623cb604 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:14.703395 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-45fb9e64-706e-4f28-9452-3aa4623cb604 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:14.703890 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-45fb9e64-706e-4f28-9452-3aa4623cb604 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:14.704354 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-45fb9e64-706e-4f28-9452-3aa4623cb604 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:14.756940 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b66c89b7-5ecc-4db9-a36b-2a0b109de603 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:14.765457 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b66c89b7-5ecc-4db9-a36b-2a0b109de603 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1510 microversion: 2.1 time: 0.189480 Aug 24 13:42:14.766222 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 254/501] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:14 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1510 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:14.845917 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-45fb9e64-706e-4f28-9452-3aa4623cb604 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:14.855243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-45fb9e64-706e-4f28-9452-3aa4623cb604 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:14.856806 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-45fb9e64-706e-4f28-9452-3aa4623cb604 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:14.857972 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-45fb9e64-706e-4f28-9452-3aa4623cb604 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1810 microversion: 2.20 time: 0.168931 Aug 24 13:42:14.858529 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 248/502] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:42:14 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:42:15.340100 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-4c22195f-a4f5-4cf7-b2b6-bc8ea2b66c36 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:15.340580 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-4c22195f-a4f5-4cf7-b2b6-bc8ea2b66c36 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:15.346784 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4c22195f-a4f5-4cf7-b2b6-bc8ea2b66c36 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:15.347267 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4c22195f-a4f5-4cf7-b2b6-bc8ea2b66c36 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:15.347722 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4c22195f-a4f5-4cf7-b2b6-bc8ea2b66c36 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:15.348468 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4c22195f-a4f5-4cf7-b2b6-bc8ea2b66c36 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:15.348895 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4c22195f-a4f5-4cf7-b2b6-bc8ea2b66c36 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:15.349354 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4c22195f-a4f5-4cf7-b2b6-bc8ea2b66c36 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:15.385774 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4c22195f-a4f5-4cf7-b2b6-bc8ea2b66c36 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:15.386290 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4c22195f-a4f5-4cf7-b2b6-bc8ea2b66c36 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:15.386929 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4c22195f-a4f5-4cf7-b2b6-bc8ea2b66c36 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:15.387734 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.objects.instance [None req-4c22195f-a4f5-4cf7-b2b6-bc8ea2b66c36 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lazy-loading 'fault' on Instance uuid 3ad88e6d-b2b8-4049-b987-94022767fa67 {{(pid=133015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:42:15.427216 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-5e40f80e-f3f4-44db-8bc7-f48a3864cfe7 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:15.428571 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-5e40f80e-f3f4-44db-8bc7-f48a3864cfe7 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:15.436295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5e40f80e-f3f4-44db-8bc7-f48a3864cfe7 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:15.436930 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5e40f80e-f3f4-44db-8bc7-f48a3864cfe7 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:15.437074 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4c22195f-a4f5-4cf7-b2b6-bc8ea2b66c36 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:15.437367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5e40f80e-f3f4-44db-8bc7-f48a3864cfe7 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:15.438066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5e40f80e-f3f4-44db-8bc7-f48a3864cfe7 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:15.438520 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5e40f80e-f3f4-44db-8bc7-f48a3864cfe7 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:15.438941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5e40f80e-f3f4-44db-8bc7-f48a3864cfe7 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:15.445130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-4c22195f-a4f5-4cf7-b2b6-bc8ea2b66c36 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 200 len: 1331 microversion: 2.1 time: 0.110123 Aug 24 13:42:15.457708 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 255/503] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:15 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:15.594553 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-5e40f80e-f3f4-44db-8bc7-f48a3864cfe7 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:15.604210 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-5e40f80e-f3f4-44db-8bc7-f48a3864cfe7 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1260 microversion: 2.1 time: 0.180685 Aug 24 13:42:15.605155 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 249/504] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:15 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:42:15.789312 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-41f707f7-2631-40ab-9dbe-2f9c7e856184 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:15.790851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-41f707f7-2631-40ab-9dbe-2f9c7e856184 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:15.799541 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-41f707f7-2631-40ab-9dbe-2f9c7e856184 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:15.800878 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-41f707f7-2631-40ab-9dbe-2f9c7e856184 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:15.805542 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-41f707f7-2631-40ab-9dbe-2f9c7e856184 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:15.805542 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-41f707f7-2631-40ab-9dbe-2f9c7e856184 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:15.805542 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-41f707f7-2631-40ab-9dbe-2f9c7e856184 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:15.805542 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-41f707f7-2631-40ab-9dbe-2f9c7e856184 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:15.883597 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-f8186ec0-d6a2-4cfd-adea-34b5ec71b5f4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:15.884492 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-f8186ec0-d6a2-4cfd-adea-34b5ec71b5f4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:15.891988 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f8186ec0-d6a2-4cfd-adea-34b5ec71b5f4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:15.892522 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f8186ec0-d6a2-4cfd-adea-34b5ec71b5f4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:15.897694 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f8186ec0-d6a2-4cfd-adea-34b5ec71b5f4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:15.897694 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f8186ec0-d6a2-4cfd-adea-34b5ec71b5f4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:15.897694 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f8186ec0-d6a2-4cfd-adea-34b5ec71b5f4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:15.897694 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f8186ec0-d6a2-4cfd-adea-34b5ec71b5f4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:16.195541 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-41f707f7-2631-40ab-9dbe-2f9c7e856184 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:16.205745 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-41f707f7-2631-40ab-9dbe-2f9c7e856184 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1510 microversion: 2.1 time: 0.421289 Aug 24 13:42:16.206965 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 256/505] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:15 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1510 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:16.240428 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-f8186ec0-d6a2-4cfd-adea-34b5ec71b5f4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:16.258300 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-f8186ec0-d6a2-4cfd-adea-34b5ec71b5f4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:16.259667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-f8186ec0-d6a2-4cfd-adea-34b5ec71b5f4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:16.261567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-f8186ec0-d6a2-4cfd-adea-34b5ec71b5f4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1797 microversion: 2.20 time: 0.383267 Aug 24 13:42:16.262275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 250/506] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:42:15 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1797 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:42:16.468430 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-21ffc433-73a9-43b1-8dbc-99eb39a99670 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:16.469060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-21ffc433-73a9-43b1-8dbc-99eb39a99670 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:16.476077 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-21ffc433-73a9-43b1-8dbc-99eb39a99670 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:16.476864 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-21ffc433-73a9-43b1-8dbc-99eb39a99670 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:16.477311 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-21ffc433-73a9-43b1-8dbc-99eb39a99670 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:16.478125 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-21ffc433-73a9-43b1-8dbc-99eb39a99670 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:16.478810 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-21ffc433-73a9-43b1-8dbc-99eb39a99670 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:16.479298 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-21ffc433-73a9-43b1-8dbc-99eb39a99670 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:16.484568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:42:16.502289 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.wsgi [None req-21ffc433-73a9-43b1-8dbc-99eb39a99670 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] HTTP exception thrown: Instance 3ad88e6d-b2b8-4049-b987-94022767fa67 could not be found. Aug 24 13:42:16.506208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-21ffc433-73a9-43b1-8dbc-99eb39a99670 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Request method failure captured: Aug 24 13:42:16.506208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 HTTP/1.1 Aug 24 13:42:16.506208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:42:16.506208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:42:16.506208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:42:16.506208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 0 Aug 24 13:42:16.506208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:42:16.506208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:42:16.506208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:42:16.506208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:42:16.506208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBinWm1p0b_H31lzxpPvzbV7rjy3F8Qzyn9V8PX7wwFXRHJCaJ71LLFkZ_Lkt8k4m1f9ymfMSrmW4KTZotPqVtGf-HmA9MGnpTEXSHWlAWKAH6WNjAbNhI-4NP4nK3tGleZkG8cnaBgxLFes9pTCCxx0p3rv03UC4QT5l95RSPxVokdw Aug 24 13:42:16.506208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:42:16.506208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:42:16.506208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:42:16.506208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:42:16.506208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:42:16.506208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:42:16.506208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:42:16.506208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:42:16.506208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:42:16.506208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:42:16.507915 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:42:16.507915 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:42:16.507915 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:42:16.507915 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:42:16.507915 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:42:16.507915 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:42:16.507915 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:42:16.507915 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: ea9d4eafe59c4c8180eece8ec9283e40 Aug 24 13:42:16.507915 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:42:16.507915 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: > Aug 24 13:42:16.507915 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Instance 3ad88e6d-b2b8-4049-b987-94022767fa67 could not be found. Aug 24 13:42:16.507915 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'id': '3ad88e6d-b2b8-4049-b987-94022767fa67'} Aug 24 13:42:16.508995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:42:16.508995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:42:16.508995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:42:16.508995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:42:16.508995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:42:16.508995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:42:16.508995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:42:16.508995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:42:16.508995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:42:16.508995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:42:16.508995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ad88e6d-b2b8-4049-b987-94022767fa67 could not be found. Aug 24 13:42:16.508995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:42:16.508995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:42:16.508995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:42:16.508995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:42:16.508995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:42:16.508995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:42:16.508995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:42:16.508995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:42:16.508995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:42:16.510376 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:42:16.510376 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:42:16.510376 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:42:16.510376 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:42:16.510376 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:42:16.510376 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:42:16.510376 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:42:16.510376 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ad88e6d-b2b8-4049-b987-94022767fa67 could not be found. Aug 24 13:42:16.510376 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:42:16.510376 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:42:16.510376 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:42:16.510376 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:42:16.510376 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:42:16.510376 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:42:16.510376 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:42:16.510376 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:42:16.510376 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ad88e6d-b2b8-4049-b987-94022767fa67 could not be found. Aug 24 13:42:16.510376 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:42:16.512953 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-21ffc433-73a9-43b1-8dbc-99eb39a99670 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Returning 404 to user: Instance 3ad88e6d-b2b8-4049-b987-94022767fa67 could not be found. {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:42:16.514365 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-21ffc433-73a9-43b1-8dbc-99eb39a99670 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 404 len: 111 microversion: 2.1 time: 0.050946 Aug 24 13:42:16.517916 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 257/507] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:16 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 13:42:16.525132 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e4914404-5e12-474a-b582-21a896c6923c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '.version_select at 0x7f96c2d82040>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:16.609006 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-e4914404-5e12-474a-b582-21a896c6923c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-124981872" status: 202 len: 0 microversion: 2.1 time: 0.088118 Aug 24 13:42:16.609607 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 251/508] 10.222.0.73 () {58 vars in 1218 bytes} [Wed Aug 24 13:42:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-124981872 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:42:16.640100 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-088e56c0-e98b-4eaf-bf06-4459a64513a4 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:16.642398 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-088e56c0-e98b-4eaf-bf06-4459a64513a4 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:16.667013 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-088e56c0-e98b-4eaf-bf06-4459a64513a4 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:16.677007 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-088e56c0-e98b-4eaf-bf06-4459a64513a4 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:16.678434 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-088e56c0-e98b-4eaf-bf06-4459a64513a4 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:16.679801 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-088e56c0-e98b-4eaf-bf06-4459a64513a4 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:16.680765 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-088e56c0-e98b-4eaf-bf06-4459a64513a4 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:16.681336 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-088e56c0-e98b-4eaf-bf06-4459a64513a4 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:17.041592 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-088e56c0-e98b-4eaf-bf06-4459a64513a4 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:17.051390 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-088e56c0-e98b-4eaf-bf06-4459a64513a4 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1260 microversion: 2.1 time: 0.424585 Aug 24 13:42:17.052582 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 258/509] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:16 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1260 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:17.268615 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-96e9e333-5797-4845-8a68-716fa9dab695 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:17.269534 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-96e9e333-5797-4845-8a68-716fa9dab695 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:17.291087 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-96e9e333-5797-4845-8a68-716fa9dab695 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:17.291870 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-96e9e333-5797-4845-8a68-716fa9dab695 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:17.292504 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-96e9e333-5797-4845-8a68-716fa9dab695 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:17.293534 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-96e9e333-5797-4845-8a68-716fa9dab695 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:17.294533 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-96e9e333-5797-4845-8a68-716fa9dab695 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:17.295216 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-96e9e333-5797-4845-8a68-716fa9dab695 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:17.700679 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-96e9e333-5797-4845-8a68-716fa9dab695 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:17.717575 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-96e9e333-5797-4845-8a68-716fa9dab695 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1516 microversion: 2.1 time: 0.479137 Aug 24 13:42:17.720866 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 252/510] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:17 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1516 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:42:18.076991 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-0308f2bc-5209-4ee0-b65f-c4748280fe32 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:18.077738 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-0308f2bc-5209-4ee0-b65f-c4748280fe32 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:18.089571 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0308f2bc-5209-4ee0-b65f-c4748280fe32 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:18.090177 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0308f2bc-5209-4ee0-b65f-c4748280fe32 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:18.090625 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0308f2bc-5209-4ee0-b65f-c4748280fe32 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:18.091618 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0308f2bc-5209-4ee0-b65f-c4748280fe32 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:18.092089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0308f2bc-5209-4ee0-b65f-c4748280fe32 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:18.092538 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0308f2bc-5209-4ee0-b65f-c4748280fe32 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:18.257472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-f832f14d-a992-4496-9d04-a627957832c8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Action: 'create', calling method: .version_select at 0x7f96c2d97790>, body: {"keypair": {"name": "tempest-keypair-324044717", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVujRDvgIq4QkcqmTxcohKNk2OJJyc/CDuOlI4KkmsMCjuJScac7lwfRe8yIABIjU7sYlO5gECv1zcLIhQgR7fOZs7SW4/FI3JpxDsze5zTw3gNcb9DI+juRvAQyuuyRw=="}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:42:18.293852 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-f832f14d-a992-4496-9d04-a627957832c8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Getting quotas for project 019b2e8bdb934d94a25fe4b355e73c68. Resources: {'key_pairs'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:42:18.299848 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-0308f2bc-5209-4ee0-b65f-c4748280fe32 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:18.300698 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-f832f14d-a992-4496-9d04-a627957832c8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Getting quotas for user ea9d4eafe59c4c8180eece8ec9283e40 and project 019b2e8bdb934d94a25fe4b355e73c68. Resources: {'key_pairs'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:42:18.308938 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-0308f2bc-5209-4ee0-b65f-c4748280fe32 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1260 microversion: 2.1 time: 0.237140 Aug 24 13:42:18.309884 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 259/511] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:18 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:18.726498 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-f832f14d-a992-4496-9d04-a627957832c8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.476686 Aug 24 13:42:18.744907 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 253/512] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 13:42:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:42:19.352167 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-5305a7c9-6af2-4c09-afec-c4cf2b87c7d9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:19.353387 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-5305a7c9-6af2-4c09-afec-c4cf2b87c7d9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:19.365800 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5305a7c9-6af2-4c09-afec-c4cf2b87c7d9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:19.367502 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5305a7c9-6af2-4c09-afec-c4cf2b87c7d9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:19.370302 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5305a7c9-6af2-4c09-afec-c4cf2b87c7d9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:19.371545 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5305a7c9-6af2-4c09-afec-c4cf2b87c7d9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:19.372574 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5305a7c9-6af2-4c09-afec-c4cf2b87c7d9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:19.373182 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5305a7c9-6af2-4c09-afec-c4cf2b87c7d9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:19.609571 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-5305a7c9-6af2-4c09-afec-c4cf2b87c7d9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:19.621450 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-5305a7c9-6af2-4c09-afec-c4cf2b87c7d9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1260 microversion: 2.1 time: 0.283304 Aug 24 13:42:19.622376 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 260/513] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:19 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1260 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:42:19.871551 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a80cd467-57be-4e32-977d-1024f4825898 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Action: 'create', calling method: .version_select at 0x7f96c2b26700>, body: {"keypair": {"name": "tempest-keypair-1585981523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCCu5tAU4viclkOD6WsxdgrbbQ1MaOREvlEpatcZuMYSqKcmQWJtIS5iiLUwUiTTUrW/Cq9Go8vcLZ+enMSEKyMw+MdLDTF97XgANqYHUP+bmD4Dn+dLVMsIQ9bsomwLw=="}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:42:19.909157 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-a80cd467-57be-4e32-977d-1024f4825898 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Getting quotas for project 127e5da55b164ce68568c153fee58baf. Resources: {'key_pairs'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:42:19.918551 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-a80cd467-57be-4e32-977d-1024f4825898 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Getting quotas for user adb792e7246d42dface4aa52899a0ffc and project 127e5da55b164ce68568c153fee58baf. Resources: {'key_pairs'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:42:20.041091 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a80cd467-57be-4e32-977d-1024f4825898 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.177452 Aug 24 13:42:20.046392 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 254/514] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 13:42:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:42:20.647654 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-f3fb3180-3e8d-4e6d-b035-955eb144babf tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:20.648961 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-f3fb3180-3e8d-4e6d-b035-955eb144babf tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:20.656934 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f3fb3180-3e8d-4e6d-b035-955eb144babf tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:20.657695 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f3fb3180-3e8d-4e6d-b035-955eb144babf tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:20.658309 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f3fb3180-3e8d-4e6d-b035-955eb144babf tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:20.659232 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f3fb3180-3e8d-4e6d-b035-955eb144babf tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:20.659863 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f3fb3180-3e8d-4e6d-b035-955eb144babf tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:20.660493 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f3fb3180-3e8d-4e6d-b035-955eb144babf tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:20.961890 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f3fb3180-3e8d-4e6d-b035-955eb144babf tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:20.986306 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-f3fb3180-3e8d-4e6d-b035-955eb144babf tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1260 microversion: 2.1 time: 0.342419 Aug 24 13:42:20.990126 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 261/515] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:20 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1260 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:22.022036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-b022a6fe-82e8-4ef6-8411-b513074e7753 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:22.022783 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-b022a6fe-82e8-4ef6-8411-b513074e7753 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:22.036247 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b022a6fe-82e8-4ef6-8411-b513074e7753 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:22.037836 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b022a6fe-82e8-4ef6-8411-b513074e7753 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:22.038477 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b022a6fe-82e8-4ef6-8411-b513074e7753 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:22.039780 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b022a6fe-82e8-4ef6-8411-b513074e7753 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:22.040431 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b022a6fe-82e8-4ef6-8411-b513074e7753 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:22.041814 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b022a6fe-82e8-4ef6-8411-b513074e7753 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:22.218476 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-b022a6fe-82e8-4ef6-8411-b513074e7753 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:22.230512 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-b022a6fe-82e8-4ef6-8411-b513074e7753 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1260 microversion: 2.1 time: 0.212729 Aug 24 13:42:22.231368 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 255/516] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:22 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1260 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:23.075387 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-1629bddd-10a5-4fc9-b29c-90c4d4a529e1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2075977917", "imageRef": "c520113c-3dae-4490-98bb-19fe3a46b66d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "789a27f6-7f62-4022-86ef-1042c82fc322"}], "security_groups": [{"name": "tempest-securitygroup--1301987101"}], "key_name": "tempest-keypair-324044717", "user_data": "}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:42:23.267256 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-80ea5cef-2ce8-4792-b663-55425eb9308b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:23.269568 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-80ea5cef-2ce8-4792-b663-55425eb9308b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:23.286605 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-80ea5cef-2ce8-4792-b663-55425eb9308b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:23.287918 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-80ea5cef-2ce8-4792-b663-55425eb9308b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:23.288646 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-80ea5cef-2ce8-4792-b663-55425eb9308b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:23.289684 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-80ea5cef-2ce8-4792-b663-55425eb9308b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:23.290405 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-80ea5cef-2ce8-4792-b663-55425eb9308b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:23.291549 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-80ea5cef-2ce8-4792-b663-55425eb9308b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:23.339612 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.network.neutron [None req-1629bddd-10a5-4fc9-b29c-90c4d4a529e1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] validate_networks() for [('789a27f6-7f62-4022-86ef-1042c82fc322', None, None, None, None, None)] {{(pid=133015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:42:23.649476 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-80ea5cef-2ce8-4792-b663-55425eb9308b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:23.669557 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-80ea5cef-2ce8-4792-b663-55425eb9308b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1260 microversion: 2.1 time: 0.419474 Aug 24 13:42:23.688802 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 256/517] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:23 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1260 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:24.226937 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-1629bddd-10a5-4fc9-b29c-90c4d4a529e1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Flavor limits 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:42:24.229383 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-1629bddd-10a5-4fc9-b29c-90c4d4a529e1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Image limits 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:42:24.230538 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-1629bddd-10a5-4fc9-b29c-90c4d4a529e1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Flavor pref 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:42:24.231519 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-1629bddd-10a5-4fc9-b29c-90c4d4a529e1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Image pref 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:42:24.232246 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-1629bddd-10a5-4fc9-b29c-90c4d4a529e1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:42:24.250872 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1629bddd-10a5-4fc9-b29c-90c4d4a529e1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:24.250872 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1629bddd-10a5-4fc9-b29c-90c4d4a529e1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:24.250872 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1629bddd-10a5-4fc9-b29c-90c4d4a529e1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:24.250872 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1629bddd-10a5-4fc9-b29c-90c4d4a529e1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:24.251646 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1629bddd-10a5-4fc9-b29c-90c4d4a529e1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:24.251646 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1629bddd-10a5-4fc9-b29c-90c4d4a529e1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:24.287427 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-1629bddd-10a5-4fc9-b29c-90c4d4a529e1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Getting quotas for project 019b2e8bdb934d94a25fe4b355e73c68. Resources: {'instances', 'cores', 'ram'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:42:24.295538 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-1629bddd-10a5-4fc9-b29c-90c4d4a529e1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Getting quotas for user ea9d4eafe59c4c8180eece8ec9283e40 and project 019b2e8bdb934d94a25fe4b355e73c68. Resources: {'instances', 'cores', 'ram'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:42:24.321502 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-1629bddd-10a5-4fc9-b29c-90c4d4a529e1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Going to run 1 instances... {{(pid=133015) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 13:42:24.324366 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-1629bddd-10a5-4fc9-b29c-90c4d4a529e1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c520113c-3dae-4490-98bb-19fe3a46b66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 13:42:24.508432 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-1629bddd-10a5-4fc9-b29c-90c4d4a529e1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.440088 Aug 24 13:42:24.510018 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 262/518] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 13:42:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 1442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 13:42:24.535057 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-02d15e92-6dab-4d03-8fb9-1fcb09c1d935 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:24.536237 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-02d15e92-6dab-4d03-8fb9-1fcb09c1d935 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:24.642193 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-02d15e92-6dab-4d03-8fb9-1fcb09c1d935 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:24.654768 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-02d15e92-6dab-4d03-8fb9-1fcb09c1d935 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84" status: 200 len: 1241 microversion: 2.1 time: 0.127016 Aug 24 13:42:24.656376 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 257/519] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:24 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84 => generated 1241 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:24.709958 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-9289339a-3893-4123-9842-bd014cc425e9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:24.710815 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-9289339a-3893-4123-9842-bd014cc425e9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:24.729939 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9289339a-3893-4123-9842-bd014cc425e9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:24.730651 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9289339a-3893-4123-9842-bd014cc425e9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:24.731260 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9289339a-3893-4123-9842-bd014cc425e9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:24.732371 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9289339a-3893-4123-9842-bd014cc425e9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:24.732994 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9289339a-3893-4123-9842-bd014cc425e9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:24.733611 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9289339a-3893-4123-9842-bd014cc425e9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:25.073114 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-9289339a-3893-4123-9842-bd014cc425e9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:25.082916 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-9289339a-3893-4123-9842-bd014cc425e9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1260 microversion: 2.1 time: 0.380021 Aug 24 13:42:25.083534 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 263/520] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:24 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1260 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:25.307886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-5d15c532-b42c-46dd-b787-cd0d69ea9b66 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-3044020", "imageRef": "c520113c-3dae-4490-98bb-19fe3a46b66d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1fcb22e0-a643-462e-8b2f-3661641fd3fe"}], "security_groups": [{"name": "tempest-securitygroup--1268775126"}], "key_name": "tempest-keypair-1585981523", "user_data": "}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:42:25.494883 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.network.neutron [None req-5d15c532-b42c-46dd-b787-cd0d69ea9b66 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] validate_networks() for [('1fcb22e0-a643-462e-8b2f-3661641fd3fe', None, None, None, None, None)] {{(pid=133014) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:42:25.691274 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-65ca2a2b-c196-4ffe-9d9a-878904d0f148 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:25.692681 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-65ca2a2b-c196-4ffe-9d9a-878904d0f148 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:25.786071 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-65ca2a2b-c196-4ffe-9d9a-878904d0f148 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:25.796290 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-65ca2a2b-c196-4ffe-9d9a-878904d0f148 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84" status: 200 len: 1241 microversion: 2.1 time: 0.109875 Aug 24 13:42:25.797509 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 264/521] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:25 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84 => generated 1241 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:42:26.105190 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-71f6fbbb-8a7f-4a86-a448-aaa7df2dabf1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:26.106731 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-71f6fbbb-8a7f-4a86-a448-aaa7df2dabf1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:26.119658 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-5d15c532-b42c-46dd-b787-cd0d69ea9b66 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Flavor limits 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:42:26.120243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-5d15c532-b42c-46dd-b787-cd0d69ea9b66 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Image limits 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:42:26.121286 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-5d15c532-b42c-46dd-b787-cd0d69ea9b66 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Flavor pref 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:42:26.121768 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-5d15c532-b42c-46dd-b787-cd0d69ea9b66 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Image pref 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:42:26.122193 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-5d15c532-b42c-46dd-b787-cd0d69ea9b66 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:42:26.127148 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-71f6fbbb-8a7f-4a86-a448-aaa7df2dabf1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:26.127645 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-71f6fbbb-8a7f-4a86-a448-aaa7df2dabf1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:26.128935 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-71f6fbbb-8a7f-4a86-a448-aaa7df2dabf1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:26.129743 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-71f6fbbb-8a7f-4a86-a448-aaa7df2dabf1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:26.130280 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-71f6fbbb-8a7f-4a86-a448-aaa7df2dabf1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:26.131059 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-71f6fbbb-8a7f-4a86-a448-aaa7df2dabf1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:26.134989 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5d15c532-b42c-46dd-b787-cd0d69ea9b66 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:26.136358 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5d15c532-b42c-46dd-b787-cd0d69ea9b66 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:26.137008 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5d15c532-b42c-46dd-b787-cd0d69ea9b66 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:26.138007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5d15c532-b42c-46dd-b787-cd0d69ea9b66 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:26.139015 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5d15c532-b42c-46dd-b787-cd0d69ea9b66 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:26.139645 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5d15c532-b42c-46dd-b787-cd0d69ea9b66 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:26.184667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-5d15c532-b42c-46dd-b787-cd0d69ea9b66 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Getting quotas for project 127e5da55b164ce68568c153fee58baf. Resources: {'instances', 'cores', 'ram'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:42:26.190769 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-5d15c532-b42c-46dd-b787-cd0d69ea9b66 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Getting quotas for user adb792e7246d42dface4aa52899a0ffc and project 127e5da55b164ce68568c153fee58baf. Resources: {'instances', 'cores', 'ram'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:42:26.209687 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-5d15c532-b42c-46dd-b787-cd0d69ea9b66 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Going to run 1 instances... {{(pid=133014) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 13:42:26.212872 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-5d15c532-b42c-46dd-b787-cd0d69ea9b66 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c520113c-3dae-4490-98bb-19fe3a46b66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133014) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 13:42:26.370640 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-71f6fbbb-8a7f-4a86-a448-aaa7df2dabf1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:26.380304 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-71f6fbbb-8a7f-4a86-a448-aaa7df2dabf1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1260 microversion: 2.1 time: 0.279208 Aug 24 13:42:26.380910 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 265/522] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:26 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1260 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:42:26.698386 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-5d15c532-b42c-46dd-b787-cd0d69ea9b66 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.398182 Aug 24 13:42:26.699430 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 258/523] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 13:42:25 2022] POST /compute/v2.1/servers => generated 409 bytes in 1400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 13:42:26.711223 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-258bb248-a5a1-44e8-8aad-37a95acae16c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:26.712701 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-258bb248-a5a1-44e8-8aad-37a95acae16c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:26.805248 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-258bb248-a5a1-44e8-8aad-37a95acae16c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:26.816827 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-258bb248-a5a1-44e8-8aad-37a95acae16c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1243 microversion: 2.1 time: 0.109438 Aug 24 13:42:26.818627 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 266/524] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:26 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1243 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:26.829434 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-b99f48fe-2de1-4f0b-8f8a-fab27408d0ac tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:26.830347 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-b99f48fe-2de1-4f0b-8f8a-fab27408d0ac tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:26.842298 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b99f48fe-2de1-4f0b-8f8a-fab27408d0ac tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:26.844342 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b99f48fe-2de1-4f0b-8f8a-fab27408d0ac tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:26.846185 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b99f48fe-2de1-4f0b-8f8a-fab27408d0ac tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:26.848422 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b99f48fe-2de1-4f0b-8f8a-fab27408d0ac tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:26.851877 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b99f48fe-2de1-4f0b-8f8a-fab27408d0ac tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:26.851877 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b99f48fe-2de1-4f0b-8f8a-fab27408d0ac tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:26.978514 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-b99f48fe-2de1-4f0b-8f8a-fab27408d0ac tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:26.988273 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-b99f48fe-2de1-4f0b-8f8a-fab27408d0ac tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84" status: 200 len: 1237 microversion: 2.1 time: 0.162893 Aug 24 13:42:26.989248 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 259/525] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:26 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84 => generated 1237 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:27.416724 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-ef89c700-5e7c-4e37-b441-555c143d9594 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:27.416724 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-ef89c700-5e7c-4e37-b441-555c143d9594 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:27.424343 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ef89c700-5e7c-4e37-b441-555c143d9594 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:27.425094 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ef89c700-5e7c-4e37-b441-555c143d9594 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:27.425721 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ef89c700-5e7c-4e37-b441-555c143d9594 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:27.426615 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ef89c700-5e7c-4e37-b441-555c143d9594 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:27.427248 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ef89c700-5e7c-4e37-b441-555c143d9594 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:27.428039 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ef89c700-5e7c-4e37-b441-555c143d9594 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:27.687064 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-ef89c700-5e7c-4e37-b441-555c143d9594 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:27.696333 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-ef89c700-5e7c-4e37-b441-555c143d9594 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1260 microversion: 2.1 time: 0.294567 Aug 24 13:42:27.696931 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 267/526] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:27 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1260 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:42:27.841952 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-09d192a8-ad76-43b7-a072-9535edd40788 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:27.842741 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-09d192a8-ad76-43b7-a072-9535edd40788 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:27.934247 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-b27db4e7-7bac-4d5a-a6f3-b28c70f29db0 req-c9c0cb08-209f-4922-af33-151433ffeb19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1118fb04-6744-4b7c-b639-0081073ee53a", "name": "network-vif-plugged", "status": "completed", "tag": "579a6bec-e4ab-438a-a263-2fafa0fe42bc"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:42:27.944622 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-09d192a8-ad76-43b7-a072-9535edd40788 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:27.961621 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-09d192a8-ad76-43b7-a072-9535edd40788 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1243 microversion: 2.1 time: 0.122030 Aug 24 13:42:27.962424 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 260/527] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:27 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1243 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:27.970604 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-b27db4e7-7bac-4d5a-a6f3-b28c70f29db0 req-c9c0cb08-209f-4922-af33-151433ffeb19 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:27.971147 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-b27db4e7-7bac-4d5a-a6f3-b28c70f29db0 req-c9c0cb08-209f-4922-af33-151433ffeb19 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:27.971588 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-b27db4e7-7bac-4d5a-a6f3-b28c70f29db0 req-c9c0cb08-209f-4922-af33-151433ffeb19 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:27.986781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-b27db4e7-7bac-4d5a-a6f3-b28c70f29db0 req-c9c0cb08-209f-4922-af33-151433ffeb19 service nova] Creating event network-vif-plugged:579a6bec-e4ab-438a-a263-2fafa0fe42bc for instance 1118fb04-6744-4b7c-b639-0081073ee53a on hv-cinder-77957 Aug 24 13:42:27.998216 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-b27db4e7-7bac-4d5a-a6f3-b28c70f29db0 req-c9c0cb08-209f-4922-af33-151433ffeb19 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071508 Aug 24 13:42:27.999525 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 268/528] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:42:28.010177 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-b9d894b1-0f5f-40f1-b2cf-d82a7df309fc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:28.011366 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-b9d894b1-0f5f-40f1-b2cf-d82a7df309fc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:28.019314 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b9d894b1-0f5f-40f1-b2cf-d82a7df309fc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:28.019845 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b9d894b1-0f5f-40f1-b2cf-d82a7df309fc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:28.020357 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b9d894b1-0f5f-40f1-b2cf-d82a7df309fc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:28.021097 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b9d894b1-0f5f-40f1-b2cf-d82a7df309fc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:28.021862 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b9d894b1-0f5f-40f1-b2cf-d82a7df309fc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:28.022323 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b9d894b1-0f5f-40f1-b2cf-d82a7df309fc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:28.161475 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-b9d894b1-0f5f-40f1-b2cf-d82a7df309fc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:28.191037 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-b9d894b1-0f5f-40f1-b2cf-d82a7df309fc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84" status: 200 len: 1301 microversion: 2.1 time: 0.185252 Aug 24 13:42:28.191736 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 261/529] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:28 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84 => generated 1301 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:28.738984 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d7ff899c-364f-4045-8ce9-554a85baf46d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:28.739803 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-d7ff899c-364f-4045-8ce9-554a85baf46d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:28.752173 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d7ff899c-364f-4045-8ce9-554a85baf46d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:28.754449 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d7ff899c-364f-4045-8ce9-554a85baf46d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:28.760490 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d7ff899c-364f-4045-8ce9-554a85baf46d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:28.763368 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d7ff899c-364f-4045-8ce9-554a85baf46d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:28.764222 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d7ff899c-364f-4045-8ce9-554a85baf46d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:28.765253 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d7ff899c-364f-4045-8ce9-554a85baf46d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:28.984020 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-6beb48a2-8c17-473c-b076-046657d9e491 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:28.985580 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-6beb48a2-8c17-473c-b076-046657d9e491 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:29.004255 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6beb48a2-8c17-473c-b076-046657d9e491 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:29.005039 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6beb48a2-8c17-473c-b076-046657d9e491 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:29.007641 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6beb48a2-8c17-473c-b076-046657d9e491 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:29.008980 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6beb48a2-8c17-473c-b076-046657d9e491 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:29.010403 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6beb48a2-8c17-473c-b076-046657d9e491 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:29.012724 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6beb48a2-8c17-473c-b076-046657d9e491 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:29.139984 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d7ff899c-364f-4045-8ce9-554a85baf46d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:29.140700 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-6beb48a2-8c17-473c-b076-046657d9e491 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:29.156591 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-6beb48a2-8c17-473c-b076-046657d9e491 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1239 microversion: 2.1 time: 0.178647 Aug 24 13:42:29.168280 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 262/530] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:28 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1239 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:29.168859 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-d7ff899c-364f-4045-8ce9-554a85baf46d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1260 microversion: 2.1 time: 0.448766 Aug 24 13:42:29.170999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 269/531] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:28 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1260 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:29.220379 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-2119a2e2-f3e8-448d-ba36-0d253d33a33d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:29.221019 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-2119a2e2-f3e8-448d-ba36-0d253d33a33d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:29.227672 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2119a2e2-f3e8-448d-ba36-0d253d33a33d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:29.228101 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2119a2e2-f3e8-448d-ba36-0d253d33a33d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:29.240244 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2119a2e2-f3e8-448d-ba36-0d253d33a33d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:29.241037 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2119a2e2-f3e8-448d-ba36-0d253d33a33d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:29.241529 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2119a2e2-f3e8-448d-ba36-0d253d33a33d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:29.241974 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2119a2e2-f3e8-448d-ba36-0d253d33a33d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:29.334009 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-2119a2e2-f3e8-448d-ba36-0d253d33a33d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:29.342025 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-2119a2e2-f3e8-448d-ba36-0d253d33a33d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84" status: 200 len: 1299 microversion: 2.1 time: 0.127775 Aug 24 13:42:29.342608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 263/532] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:29 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84 => generated 1299 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:30.181202 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-412dafc8-d143-4ab4-98e9-3cd6d7c7dcdd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:30.182464 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-412dafc8-d143-4ab4-98e9-3cd6d7c7dcdd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:30.194296 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-412dafc8-d143-4ab4-98e9-3cd6d7c7dcdd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:30.196795 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-412dafc8-d143-4ab4-98e9-3cd6d7c7dcdd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:30.198013 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-412dafc8-d143-4ab4-98e9-3cd6d7c7dcdd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:30.199635 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-412dafc8-d143-4ab4-98e9-3cd6d7c7dcdd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:30.200941 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-412dafc8-d143-4ab4-98e9-3cd6d7c7dcdd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:30.202149 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-412dafc8-d143-4ab4-98e9-3cd6d7c7dcdd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:30.205623 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-9bb7dfde-a633-4172-8286-be924b58c660 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:30.206650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-9bb7dfde-a633-4172-8286-be924b58c660 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:30.214874 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9bb7dfde-a633-4172-8286-be924b58c660 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:30.215654 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9bb7dfde-a633-4172-8286-be924b58c660 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:30.216324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9bb7dfde-a633-4172-8286-be924b58c660 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:30.224265 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9bb7dfde-a633-4172-8286-be924b58c660 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:30.225395 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9bb7dfde-a633-4172-8286-be924b58c660 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:30.233264 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9bb7dfde-a633-4172-8286-be924b58c660 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:30.339609 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-412dafc8-d143-4ab4-98e9-3cd6d7c7dcdd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:30.347372 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-412dafc8-d143-4ab4-98e9-3cd6d7c7dcdd tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1295 microversion: 2.1 time: 0.171771 Aug 24 13:42:30.349085 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 270/533] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:30 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1295 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:30.368573 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-09fa932d-fed2-4441-be11-0cf71b9ecedb tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:30.369642 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-09fa932d-fed2-4441-be11-0cf71b9ecedb tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:30.375999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-09fa932d-fed2-4441-be11-0cf71b9ecedb tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:30.376797 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-09fa932d-fed2-4441-be11-0cf71b9ecedb tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:30.378887 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-09fa932d-fed2-4441-be11-0cf71b9ecedb tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:30.379652 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-09fa932d-fed2-4441-be11-0cf71b9ecedb tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:30.380131 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-09fa932d-fed2-4441-be11-0cf71b9ecedb tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:30.380671 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-09fa932d-fed2-4441-be11-0cf71b9ecedb tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:30.687800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-9bb7dfde-a633-4172-8286-be924b58c660 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:30.703693 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-9bb7dfde-a633-4172-8286-be924b58c660 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1260 microversion: 2.1 time: 0.504086 Aug 24 13:42:30.705261 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 264/534] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:30 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1260 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:30.850940 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-09fa932d-fed2-4441-be11-0cf71b9ecedb tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:30.876346 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-09fa932d-fed2-4441-be11-0cf71b9ecedb tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84" status: 200 len: 1367 microversion: 2.1 time: 0.510525 Aug 24 13:42:30.893509 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 271/535] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:30 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84 => generated 1367 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:31.166109 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-a8e279b4-b9f3-43e6-8770-6f8d68634644 req-e22a919f-4831-4fd5-9fc4-1abd81cac44b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fb46333-4237-44a1-8a88-7d5171bfdb84", "tag": "4e40061a-00da-4a8b-ae82-5150e0416828"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:42:31.176575 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-a8e279b4-b9f3-43e6-8770-6f8d68634644 req-e22a919f-4831-4fd5-9fc4-1abd81cac44b service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:31.177455 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-a8e279b4-b9f3-43e6-8770-6f8d68634644 req-e22a919f-4831-4fd5-9fc4-1abd81cac44b service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:31.178136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-a8e279b4-b9f3-43e6-8770-6f8d68634644 req-e22a919f-4831-4fd5-9fc4-1abd81cac44b service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:31.193718 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-a8e279b4-b9f3-43e6-8770-6f8d68634644 req-e22a919f-4831-4fd5-9fc4-1abd81cac44b service nova] Creating event network-changed:4e40061a-00da-4a8b-ae82-5150e0416828 for instance 5fb46333-4237-44a1-8a88-7d5171bfdb84 on hv-cinder-77957 Aug 24 13:42:31.200573 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-a8e279b4-b9f3-43e6-8770-6f8d68634644 req-e22a919f-4831-4fd5-9fc4-1abd81cac44b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038800 Aug 24 13:42:31.204823 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 265/536] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:42:31.371213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-36dc84b0-7db0-4a07-ba6e-d59a88edc5a4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:31.372712 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-36dc84b0-7db0-4a07-ba6e-d59a88edc5a4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:31.379360 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-36dc84b0-7db0-4a07-ba6e-d59a88edc5a4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:31.379922 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-36dc84b0-7db0-4a07-ba6e-d59a88edc5a4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:31.383729 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-36dc84b0-7db0-4a07-ba6e-d59a88edc5a4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:31.383729 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-36dc84b0-7db0-4a07-ba6e-d59a88edc5a4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:31.383729 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-36dc84b0-7db0-4a07-ba6e-d59a88edc5a4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:31.383729 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-36dc84b0-7db0-4a07-ba6e-d59a88edc5a4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:31.463048 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-36dc84b0-7db0-4a07-ba6e-d59a88edc5a4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:31.478710 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-36dc84b0-7db0-4a07-ba6e-d59a88edc5a4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1301 microversion: 2.1 time: 0.111605 Aug 24 13:42:31.481324 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 272/537] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:31 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1301 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:31.730904 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-f613564c-deac-4aa4-8f52-e79d67b1c9bb tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:31.731612 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-f613564c-deac-4aa4-8f52-e79d67b1c9bb tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:31.741723 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f613564c-deac-4aa4-8f52-e79d67b1c9bb tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:31.745173 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f613564c-deac-4aa4-8f52-e79d67b1c9bb tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:31.752097 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f613564c-deac-4aa4-8f52-e79d67b1c9bb tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:31.753100 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f613564c-deac-4aa4-8f52-e79d67b1c9bb tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:31.753848 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f613564c-deac-4aa4-8f52-e79d67b1c9bb tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:31.754451 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f613564c-deac-4aa4-8f52-e79d67b1c9bb tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:31.921049 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-50c0da25-8a53-435e-acea-813aceb6f4b6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:31.922831 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-50c0da25-8a53-435e-acea-813aceb6f4b6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:31.937580 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-50c0da25-8a53-435e-acea-813aceb6f4b6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:31.939080 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-50c0da25-8a53-435e-acea-813aceb6f4b6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:31.940113 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-50c0da25-8a53-435e-acea-813aceb6f4b6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:31.942509 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-50c0da25-8a53-435e-acea-813aceb6f4b6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:31.943548 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-50c0da25-8a53-435e-acea-813aceb6f4b6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:31.944446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-50c0da25-8a53-435e-acea-813aceb6f4b6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:32.555192 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-f613564c-deac-4aa4-8f52-e79d67b1c9bb tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:32.584415 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-50c0da25-8a53-435e-acea-813aceb6f4b6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:32.585360 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-f613564c-deac-4aa4-8f52-e79d67b1c9bb tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1445 microversion: 2.1 time: 0.844849 Aug 24 13:42:32.585360 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 266/538] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:31 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1445 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:32.585360 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-225781f1-3663-4bfd-9f44-8b1291158615 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:32.585360 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-225781f1-3663-4bfd-9f44-8b1291158615 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:32.597867 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-225781f1-3663-4bfd-9f44-8b1291158615 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:32.599467 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-225781f1-3663-4bfd-9f44-8b1291158615 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:32.603451 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-225781f1-3663-4bfd-9f44-8b1291158615 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:32.603451 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-225781f1-3663-4bfd-9f44-8b1291158615 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:32.603451 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-225781f1-3663-4bfd-9f44-8b1291158615 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:32.603451 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-225781f1-3663-4bfd-9f44-8b1291158615 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:32.679225 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-50c0da25-8a53-435e-acea-813aceb6f4b6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84" status: 200 len: 1367 microversion: 2.1 time: 0.767681 Aug 24 13:42:32.696346 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 273/539] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:31 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84 => generated 1367 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:32.713413 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-2020de7f-dc3a-485b-8d88-0511433a065c tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:32.713413 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-2020de7f-dc3a-485b-8d88-0511433a065c tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:32.742862 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2020de7f-dc3a-485b-8d88-0511433a065c tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:32.770458 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2020de7f-dc3a-485b-8d88-0511433a065c tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:32.773568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2020de7f-dc3a-485b-8d88-0511433a065c tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:32.780597 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2020de7f-dc3a-485b-8d88-0511433a065c tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:32.781649 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2020de7f-dc3a-485b-8d88-0511433a065c tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:32.782435 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2020de7f-dc3a-485b-8d88-0511433a065c tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:32.915647 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-225781f1-3663-4bfd-9f44-8b1291158615 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:32.933972 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-225781f1-3663-4bfd-9f44-8b1291158615 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1301 microversion: 2.1 time: 0.356965 Aug 24 13:42:32.953356 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 267/540] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:32 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1301 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:33.284001 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2020de7f-dc3a-485b-8d88-0511433a065c tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:33.298960 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-2020de7f-dc3a-485b-8d88-0511433a065c tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1445 microversion: 2.1 time: 0.608952 Aug 24 13:42:33.304456 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 274/541] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:32 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1445 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:33.735228 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-599b6081-7c00-43dd-9507-1f865a9658b8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:33.735925 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-599b6081-7c00-43dd-9507-1f865a9658b8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:33.926874 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-599b6081-7c00-43dd-9507-1f865a9658b8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:33.926874 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-599b6081-7c00-43dd-9507-1f865a9658b8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:33.926874 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-599b6081-7c00-43dd-9507-1f865a9658b8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:33.926874 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-599b6081-7c00-43dd-9507-1f865a9658b8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:33.928727 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-599b6081-7c00-43dd-9507-1f865a9658b8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:33.928727 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-599b6081-7c00-43dd-9507-1f865a9658b8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:33.983341 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-db9b39ed-3777-4da8-9222-ecc79c2f7510 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:33.996413 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-db9b39ed-3777-4da8-9222-ecc79c2f7510 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:34.018976 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-db9b39ed-3777-4da8-9222-ecc79c2f7510 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:34.019873 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-db9b39ed-3777-4da8-9222-ecc79c2f7510 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:34.020732 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-db9b39ed-3777-4da8-9222-ecc79c2f7510 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:34.022033 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-db9b39ed-3777-4da8-9222-ecc79c2f7510 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:34.024414 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-db9b39ed-3777-4da8-9222-ecc79c2f7510 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:34.025347 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-db9b39ed-3777-4da8-9222-ecc79c2f7510 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:34.267474 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=2 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:42:34.479090 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-599b6081-7c00-43dd-9507-1f865a9658b8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:34.490549 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-599b6081-7c00-43dd-9507-1f865a9658b8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84" status: 200 len: 1367 microversion: 2.1 time: 0.762000 Aug 24 13:42:34.492035 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 268/542] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:33 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84 => generated 1367 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:34.580475 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-db9b39ed-3777-4da8-9222-ecc79c2f7510 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:34.598248 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-db9b39ed-3777-4da8-9222-ecc79c2f7510 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1369 microversion: 2.1 time: 0.632655 Aug 24 13:42:34.599357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 275/543] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:33 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1369 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:35.537102 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-4cf9ee3a-fc07-4e20-89e6-50e67ac4d495 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:35.539033 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-4cf9ee3a-fc07-4e20-89e6-50e67ac4d495 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:35.545406 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:42:35.556210 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4cf9ee3a-fc07-4e20-89e6-50e67ac4d495 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:35.557067 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4cf9ee3a-fc07-4e20-89e6-50e67ac4d495 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:35.558770 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4cf9ee3a-fc07-4e20-89e6-50e67ac4d495 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:35.560098 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4cf9ee3a-fc07-4e20-89e6-50e67ac4d495 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:35.562961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4cf9ee3a-fc07-4e20-89e6-50e67ac4d495 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:35.563778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4cf9ee3a-fc07-4e20-89e6-50e67ac4d495 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:35.638670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-1d5dd597-620c-4db8-a2a3-c6b63346b9ed tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:35.640273 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-1d5dd597-620c-4db8-a2a3-c6b63346b9ed tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:35.647889 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1d5dd597-620c-4db8-a2a3-c6b63346b9ed tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:35.648476 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1d5dd597-620c-4db8-a2a3-c6b63346b9ed tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:35.648933 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1d5dd597-620c-4db8-a2a3-c6b63346b9ed tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:35.649691 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1d5dd597-620c-4db8-a2a3-c6b63346b9ed tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:35.651080 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1d5dd597-620c-4db8-a2a3-c6b63346b9ed tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:35.651871 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1d5dd597-620c-4db8-a2a3-c6b63346b9ed tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:36.171028 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=2 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:42:36.516646 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-4cf9ee3a-fc07-4e20-89e6-50e67ac4d495 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:36.527022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-4cf9ee3a-fc07-4e20-89e6-50e67ac4d495 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84" status: 200 len: 1367 microversion: 2.1 time: 1.002925 Aug 24 13:42:36.539656 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 269/544] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:35 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84 => generated 1367 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:36.576474 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-1d5dd597-620c-4db8-a2a3-c6b63346b9ed tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:36.595622 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-1d5dd597-620c-4db8-a2a3-c6b63346b9ed tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1369 microversion: 2.1 time: 0.963906 Aug 24 13:42:36.596525 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 276/545] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:35 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1369 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:37.549744 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-86ed2751-f6f1-45e1-a1b0-52e1397dccab tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:37.551161 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-86ed2751-f6f1-45e1-a1b0-52e1397dccab tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:37.559071 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-86ed2751-f6f1-45e1-a1b0-52e1397dccab tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:37.559990 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-86ed2751-f6f1-45e1-a1b0-52e1397dccab tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:37.560721 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-86ed2751-f6f1-45e1-a1b0-52e1397dccab tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:37.562476 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-86ed2751-f6f1-45e1-a1b0-52e1397dccab tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:37.563508 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-86ed2751-f6f1-45e1-a1b0-52e1397dccab tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:37.564197 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-86ed2751-f6f1-45e1-a1b0-52e1397dccab tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:37.591887 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=100 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:42:37.623464 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-2021d1ea-cda0-40b4-84e9-95ba5a7ee0c5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:37.626661 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-2021d1ea-cda0-40b4-84e9-95ba5a7ee0c5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:37.641236 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=10 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:42:37.643173 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2021d1ea-cda0-40b4-84e9-95ba5a7ee0c5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:37.643685 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2021d1ea-cda0-40b4-84e9-95ba5a7ee0c5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:37.644127 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2021d1ea-cda0-40b4-84e9-95ba5a7ee0c5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:37.653357 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2021d1ea-cda0-40b4-84e9-95ba5a7ee0c5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:37.654224 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2021d1ea-cda0-40b4-84e9-95ba5a7ee0c5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:37.660316 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2021d1ea-cda0-40b4-84e9-95ba5a7ee0c5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:37.952134 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=18 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:42:38.115502 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-86ed2751-f6f1-45e1-a1b0-52e1397dccab tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:38.132169 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-86ed2751-f6f1-45e1-a1b0-52e1397dccab tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84" status: 200 len: 1367 microversion: 2.1 time: 0.586488 Aug 24 13:42:38.132779 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 270/546] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:37 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84 => generated 1367 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:38.142200 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-5636e7b7-36ab-452b-8472-f22331c0becb req-fd801a70-3710-4df5-9ca9-c0fab594d12d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1b259b6-2024-4b30-865d-17dadaef5406", "tag": "7aadab9f-67a3-4721-a287-269890ea0757"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:42:38.163397 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-5636e7b7-36ab-452b-8472-f22331c0becb req-fd801a70-3710-4df5-9ca9-c0fab594d12d service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:38.164045 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-5636e7b7-36ab-452b-8472-f22331c0becb req-fd801a70-3710-4df5-9ca9-c0fab594d12d service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:38.164634 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-5636e7b7-36ab-452b-8472-f22331c0becb req-fd801a70-3710-4df5-9ca9-c0fab594d12d service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:38.184170 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-5636e7b7-36ab-452b-8472-f22331c0becb req-fd801a70-3710-4df5-9ca9-c0fab594d12d service nova] Creating event network-changed:7aadab9f-67a3-4721-a287-269890ea0757 for instance c1b259b6-2024-4b30-865d-17dadaef5406 on hv-cinder-77957 Aug 24 13:42:38.193122 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-5636e7b7-36ab-452b-8472-f22331c0becb req-fd801a70-3710-4df5-9ca9-c0fab594d12d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058389 Aug 24 13:42:38.194164 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 271/547] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:42:38.302597 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2021d1ea-cda0-40b4-84e9-95ba5a7ee0c5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:38.309396 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=100 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:42:38.319860 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-2021d1ea-cda0-40b4-84e9-95ba5a7ee0c5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1369 microversion: 2.1 time: 0.705239 Aug 24 13:42:38.320991 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 277/548] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:37 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1369 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:39.158976 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-635f56de-93fc-4314-a5e2-461078bb8fc0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:39.159861 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-635f56de-93fc-4314-a5e2-461078bb8fc0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:39.166814 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-635f56de-93fc-4314-a5e2-461078bb8fc0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:39.167435 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-635f56de-93fc-4314-a5e2-461078bb8fc0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:39.171513 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-635f56de-93fc-4314-a5e2-461078bb8fc0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:39.171513 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-635f56de-93fc-4314-a5e2-461078bb8fc0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:39.171513 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-635f56de-93fc-4314-a5e2-461078bb8fc0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:39.171513 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-635f56de-93fc-4314-a5e2-461078bb8fc0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:39.373645 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-67412d61-524e-427f-9e28-9fe38fa6c15f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:39.377484 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-67412d61-524e-427f-9e28-9fe38fa6c15f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:39.382433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-67412d61-524e-427f-9e28-9fe38fa6c15f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:39.386831 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-67412d61-524e-427f-9e28-9fe38fa6c15f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:39.387444 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-67412d61-524e-427f-9e28-9fe38fa6c15f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:39.388239 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-67412d61-524e-427f-9e28-9fe38fa6c15f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:39.388807 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-67412d61-524e-427f-9e28-9fe38fa6c15f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:39.389560 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-67412d61-524e-427f-9e28-9fe38fa6c15f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:39.523144 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-635f56de-93fc-4314-a5e2-461078bb8fc0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:39.531086 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-635f56de-93fc-4314-a5e2-461078bb8fc0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84" status: 200 len: 1367 microversion: 2.1 time: 0.376316 Aug 24 13:42:39.546186 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 272/549] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:39 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84 => generated 1367 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:39.631720 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-67412d61-524e-427f-9e28-9fe38fa6c15f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:39.640968 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-67412d61-524e-427f-9e28-9fe38fa6c15f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1369 microversion: 2.1 time: 0.280711 Aug 24 13:42:39.656444 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 278/550] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:39 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1369 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:42:39.836863 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-1230a753-90ad-439d-b2b5-7c7936b0a8cb req-8b2a7150-e06f-4ce7-8fc8-fcf5c382e83f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb46333-4237-44a1-8a88-7d5171bfdb84", "name": "network-vif-plugged", "status": "completed", "tag": "4e40061a-00da-4a8b-ae82-5150e0416828"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:42:39.856895 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-1230a753-90ad-439d-b2b5-7c7936b0a8cb req-8b2a7150-e06f-4ce7-8fc8-fcf5c382e83f service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:39.857486 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-1230a753-90ad-439d-b2b5-7c7936b0a8cb req-8b2a7150-e06f-4ce7-8fc8-fcf5c382e83f service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:39.858006 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-1230a753-90ad-439d-b2b5-7c7936b0a8cb req-8b2a7150-e06f-4ce7-8fc8-fcf5c382e83f service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:39.873620 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-1230a753-90ad-439d-b2b5-7c7936b0a8cb req-8b2a7150-e06f-4ce7-8fc8-fcf5c382e83f service nova] Creating event network-vif-plugged:4e40061a-00da-4a8b-ae82-5150e0416828 for instance 5fb46333-4237-44a1-8a88-7d5171bfdb84 on hv-cinder-77957 Aug 24 13:42:39.879314 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-1230a753-90ad-439d-b2b5-7c7936b0a8cb req-8b2a7150-e06f-4ce7-8fc8-fcf5c382e83f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048862 Aug 24 13:42:39.880401 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 273/551] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:42:40.254919 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-1091b751-1cd6-496e-84cc-ae665d627155 req-914f6c32-6e21-43cd-b54d-79ccd9ac31a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1118fb04-6744-4b7c-b639-0081073ee53a", "tag": "579a6bec-e4ab-438a-a263-2fafa0fe42bc"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:42:40.266983 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-1091b751-1cd6-496e-84cc-ae665d627155 req-914f6c32-6e21-43cd-b54d-79ccd9ac31a6 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:40.267804 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-1091b751-1cd6-496e-84cc-ae665d627155 req-914f6c32-6e21-43cd-b54d-79ccd9ac31a6 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:40.268432 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-1091b751-1cd6-496e-84cc-ae665d627155 req-914f6c32-6e21-43cd-b54d-79ccd9ac31a6 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:40.283588 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-1091b751-1cd6-496e-84cc-ae665d627155 req-914f6c32-6e21-43cd-b54d-79ccd9ac31a6 service nova] Creating event network-changed:579a6bec-e4ab-438a-a263-2fafa0fe42bc for instance 1118fb04-6744-4b7c-b639-0081073ee53a on hv-cinder-77957 Aug 24 13:42:40.290109 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-1091b751-1cd6-496e-84cc-ae665d627155 req-914f6c32-6e21-43cd-b54d-79ccd9ac31a6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039056 Aug 24 13:42:40.296696 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 279/552] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:42:40.554162 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-114ca186-1be9-4488-aa33-386ac38bffde tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:40.556365 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-114ca186-1be9-4488-aa33-386ac38bffde tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:40.572367 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-114ca186-1be9-4488-aa33-386ac38bffde tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:40.573221 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-114ca186-1be9-4488-aa33-386ac38bffde tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:40.573665 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-114ca186-1be9-4488-aa33-386ac38bffde tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:40.574386 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-114ca186-1be9-4488-aa33-386ac38bffde tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:40.574830 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-114ca186-1be9-4488-aa33-386ac38bffde tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:40.575228 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-54d33467-20f0-4d52-a129-8b311f79bb77 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Action: 'create', calling method: .version_select at 0x7f96c2d11700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-797259511", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3ujNi9IR2XqBn4KDiopQtI75mGBGcUmNHAmADvP4HSeC9AV8jZbqhjKhBI/N35p/Y9tEUzAVGxFQjQoRjc7xRs6KOKb4suJY4CVZnTcSZNeRzCoeMLrPijkMz7NnSG/A=="}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:42:40.575716 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-114ca186-1be9-4488-aa33-386ac38bffde tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:40.600287 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-54d33467-20f0-4d52-a129-8b311f79bb77 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Getting quotas for project 6842f55d3dcc42289b6bfe02ed020dc4. Resources: {'key_pairs'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:42:40.607995 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-54d33467-20f0-4d52-a129-8b311f79bb77 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Getting quotas for user 98b30f0436864263b2829921f212f8ce and project 6842f55d3dcc42289b6bfe02ed020dc4. Resources: {'key_pairs'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:42:40.747930 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-54d33467-20f0-4d52-a129-8b311f79bb77 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.441871 Aug 24 13:42:40.760023 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 274/553] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 13:42:40 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:42:40.762180 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-fa9f045d-065e-4a5b-8c9e-98b2eb73557b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:40.763063 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-fa9f045d-065e-4a5b-8c9e-98b2eb73557b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:40.782287 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fa9f045d-065e-4a5b-8c9e-98b2eb73557b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:40.783149 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fa9f045d-065e-4a5b-8c9e-98b2eb73557b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:40.783761 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fa9f045d-065e-4a5b-8c9e-98b2eb73557b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:40.784480 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fa9f045d-065e-4a5b-8c9e-98b2eb73557b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:40.784944 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fa9f045d-065e-4a5b-8c9e-98b2eb73557b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:40.785504 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fa9f045d-065e-4a5b-8c9e-98b2eb73557b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:41.159403 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-114ca186-1be9-4488-aa33-386ac38bffde tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:41.174955 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-114ca186-1be9-4488-aa33-386ac38bffde tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84" status: 200 len: 1367 microversion: 2.1 time: 0.625972 Aug 24 13:42:41.179242 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 280/554] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:40 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84 => generated 1367 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:41.218476 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-fa9f045d-065e-4a5b-8c9e-98b2eb73557b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:41.232070 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-fa9f045d-065e-4a5b-8c9e-98b2eb73557b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1369 microversion: 2.1 time: 0.475024 Aug 24 13:42:41.233086 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 275/555] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:40 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1369 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:42.203847 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-8de1fdfd-3dab-426d-ba15-36641c7b8b5d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:42.206147 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-8de1fdfd-3dab-426d-ba15-36641c7b8b5d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:42.210493 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:42:42.225469 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8de1fdfd-3dab-426d-ba15-36641c7b8b5d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:42.226452 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8de1fdfd-3dab-426d-ba15-36641c7b8b5d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:42.227691 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8de1fdfd-3dab-426d-ba15-36641c7b8b5d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:42.232325 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8de1fdfd-3dab-426d-ba15-36641c7b8b5d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:42.233763 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8de1fdfd-3dab-426d-ba15-36641c7b8b5d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:42.234847 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8de1fdfd-3dab-426d-ba15-36641c7b8b5d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:42.256834 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-cd13b63c-a2ec-4938-80a0-5f3f698d67f2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:42.258223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-cd13b63c-a2ec-4938-80a0-5f3f698d67f2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:42.272888 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cd13b63c-a2ec-4938-80a0-5f3f698d67f2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:42.274438 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cd13b63c-a2ec-4938-80a0-5f3f698d67f2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:42.275312 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cd13b63c-a2ec-4938-80a0-5f3f698d67f2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:42.278505 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cd13b63c-a2ec-4938-80a0-5f3f698d67f2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:42.279610 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cd13b63c-a2ec-4938-80a0-5f3f698d67f2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:42.281250 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cd13b63c-a2ec-4938-80a0-5f3f698d67f2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:42.658270 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-8de1fdfd-3dab-426d-ba15-36641c7b8b5d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:42.670110 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-8de1fdfd-3dab-426d-ba15-36641c7b8b5d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84" status: 200 len: 1367 microversion: 2.1 time: 0.475121 Aug 24 13:42:42.671705 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 281/556] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:42 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84 => generated 1367 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:42.708016 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-cd13b63c-a2ec-4938-80a0-5f3f698d67f2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:42.719405 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-cd13b63c-a2ec-4938-80a0-5f3f698d67f2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1369 microversion: 2.1 time: 0.467536 Aug 24 13:42:42.720517 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 276/557] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:42 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1369 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:43.711154 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-913210d8-5fb0-418b-a1b4-2849f866bbb2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:43.713332 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-913210d8-5fb0-418b-a1b4-2849f866bbb2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:43.721123 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-913210d8-5fb0-418b-a1b4-2849f866bbb2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:43.721625 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-913210d8-5fb0-418b-a1b4-2849f866bbb2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:43.722065 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-913210d8-5fb0-418b-a1b4-2849f866bbb2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:43.722781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-913210d8-5fb0-418b-a1b4-2849f866bbb2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:43.723232 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-913210d8-5fb0-418b-a1b4-2849f866bbb2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:43.723660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-913210d8-5fb0-418b-a1b4-2849f866bbb2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:43.750417 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-58153612-fef8-4925-b2bc-90d479761bbc tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:43.751211 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-58153612-fef8-4925-b2bc-90d479761bbc tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:43.758002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-58153612-fef8-4925-b2bc-90d479761bbc tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:43.758583 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-58153612-fef8-4925-b2bc-90d479761bbc tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:43.761810 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-58153612-fef8-4925-b2bc-90d479761bbc tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:43.761810 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-58153612-fef8-4925-b2bc-90d479761bbc tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:43.761810 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-58153612-fef8-4925-b2bc-90d479761bbc tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:43.761810 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-58153612-fef8-4925-b2bc-90d479761bbc tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:43.984741 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-58153612-fef8-4925-b2bc-90d479761bbc tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:43.992718 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-913210d8-5fb0-418b-a1b4-2849f866bbb2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:44.003139 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-913210d8-5fb0-418b-a1b4-2849f866bbb2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84" status: 200 len: 1557 microversion: 2.1 time: 0.298169 Aug 24 13:42:44.003736 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 282/558] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:43 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84 => generated 1557 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:44.008768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-d2f66b39-49e8-4979-94af-4f208542bc9b req-5b21c1c4-f51b-4887-8bfd-001687dbee82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1b259b6-2024-4b30-865d-17dadaef5406", "name": "network-vif-plugged", "status": "completed", "tag": "7aadab9f-67a3-4721-a287-269890ea0757"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:42:44.017193 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-58153612-fef8-4925-b2bc-90d479761bbc tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1369 microversion: 2.1 time: 0.276159 Aug 24 13:42:44.019540 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-d2f66b39-49e8-4979-94af-4f208542bc9b req-5b21c1c4-f51b-4887-8bfd-001687dbee82 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:44.020025 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-d2f66b39-49e8-4979-94af-4f208542bc9b req-5b21c1c4-f51b-4887-8bfd-001687dbee82 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:44.020494 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-d2f66b39-49e8-4979-94af-4f208542bc9b req-5b21c1c4-f51b-4887-8bfd-001687dbee82 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:44.026464 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 277/559] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:43 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1369 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:44.033424 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-d2f66b39-49e8-4979-94af-4f208542bc9b req-5b21c1c4-f51b-4887-8bfd-001687dbee82 service nova] Creating event network-vif-plugged:7aadab9f-67a3-4721-a287-269890ea0757 for instance c1b259b6-2024-4b30-865d-17dadaef5406 on hv-cinder-77957 Aug 24 13:42:44.039674 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-d2f66b39-49e8-4979-94af-4f208542bc9b req-5b21c1c4-f51b-4887-8bfd-001687dbee82 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034060 Aug 24 13:42:44.040322 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 283/560] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:42:44.049280 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-346a5117-c36a-439a-b29c-82462571959b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:44.053162 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-346a5117-c36a-439a-b29c-82462571959b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:44.057490 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-346a5117-c36a-439a-b29c-82462571959b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:44.058178 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-346a5117-c36a-439a-b29c-82462571959b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:44.058836 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-346a5117-c36a-439a-b29c-82462571959b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:44.059776 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-346a5117-c36a-439a-b29c-82462571959b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:44.060473 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-346a5117-c36a-439a-b29c-82462571959b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:44.060983 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-346a5117-c36a-439a-b29c-82462571959b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:44.157941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-346a5117-c36a-439a-b29c-82462571959b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122800 Aug 24 13:42:44.160610 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 278/561] 10.222.0.73 () {58 vars in 1275 bytes} [Wed Aug 24 13:42:44 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:42:45.047362 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-0509fbad-db46-4c46-b0bc-40b6188e2030 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:45.048862 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-0509fbad-db46-4c46-b0bc-40b6188e2030 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:45.063764 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0509fbad-db46-4c46-b0bc-40b6188e2030 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:45.064688 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0509fbad-db46-4c46-b0bc-40b6188e2030 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:45.065478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0509fbad-db46-4c46-b0bc-40b6188e2030 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:45.066780 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0509fbad-db46-4c46-b0bc-40b6188e2030 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:45.067624 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0509fbad-db46-4c46-b0bc-40b6188e2030 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:45.068577 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0509fbad-db46-4c46-b0bc-40b6188e2030 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:45.274106 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-0509fbad-db46-4c46-b0bc-40b6188e2030 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:45.283802 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-0509fbad-db46-4c46-b0bc-40b6188e2030 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1369 microversion: 2.1 time: 0.247166 Aug 24 13:42:45.288923 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 284/562] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:45 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1369 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:42:45.706103 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-d3a94e15-f90f-4a6b-8dd1-e3f7fde866cf req-abdf11ad-65b0-4b08-b32c-298dbf6e6cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fb46333-4237-44a1-8a88-7d5171bfdb84", "tag": "4e40061a-00da-4a8b-ae82-5150e0416828"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:42:45.724921 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-d3a94e15-f90f-4a6b-8dd1-e3f7fde866cf req-abdf11ad-65b0-4b08-b32c-298dbf6e6cf9 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:45.725871 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-d3a94e15-f90f-4a6b-8dd1-e3f7fde866cf req-abdf11ad-65b0-4b08-b32c-298dbf6e6cf9 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:45.726634 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-d3a94e15-f90f-4a6b-8dd1-e3f7fde866cf req-abdf11ad-65b0-4b08-b32c-298dbf6e6cf9 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:45.750774 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-d3a94e15-f90f-4a6b-8dd1-e3f7fde866cf req-abdf11ad-65b0-4b08-b32c-298dbf6e6cf9 service nova] Creating event network-changed:4e40061a-00da-4a8b-ae82-5150e0416828 for instance 5fb46333-4237-44a1-8a88-7d5171bfdb84 on hv-cinder-77957 Aug 24 13:42:45.760521 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-d3a94e15-f90f-4a6b-8dd1-e3f7fde866cf req-abdf11ad-65b0-4b08-b32c-298dbf6e6cf9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061375 Aug 24 13:42:45.761755 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 279/563] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:42:46.308395 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-00aef9d8-cd0d-4955-b5cd-b67eee50e15c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:46.309204 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-00aef9d8-cd0d-4955-b5cd-b67eee50e15c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:46.317829 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-00aef9d8-cd0d-4955-b5cd-b67eee50e15c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:46.318449 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-00aef9d8-cd0d-4955-b5cd-b67eee50e15c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:46.319342 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-00aef9d8-cd0d-4955-b5cd-b67eee50e15c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:46.320131 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-00aef9d8-cd0d-4955-b5cd-b67eee50e15c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:46.320632 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-00aef9d8-cd0d-4955-b5cd-b67eee50e15c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:46.321053 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-00aef9d8-cd0d-4955-b5cd-b67eee50e15c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:46.534862 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-00aef9d8-cd0d-4955-b5cd-b67eee50e15c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:46.551084 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-00aef9d8-cd0d-4955-b5cd-b67eee50e15c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1564 microversion: 2.1 time: 0.247626 Aug 24 13:42:46.552397 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 285/564] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:42:46 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1564 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:42:46.589211 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-19cc7ddd-9373-4467-b708-8c0cd030a47c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:46.590246 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-19cc7ddd-9373-4467-b708-8c0cd030a47c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:46.603999 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-19cc7ddd-9373-4467-b708-8c0cd030a47c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:46.605028 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-19cc7ddd-9373-4467-b708-8c0cd030a47c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:46.605838 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-19cc7ddd-9373-4467-b708-8c0cd030a47c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:46.607073 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-19cc7ddd-9373-4467-b708-8c0cd030a47c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:46.607977 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-19cc7ddd-9373-4467-b708-8c0cd030a47c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:46.608755 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-19cc7ddd-9373-4467-b708-8c0cd030a47c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:46.826873 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-19cc7ddd-9373-4467-b708-8c0cd030a47c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.246998 Aug 24 13:42:46.828758 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 280/565] 10.222.0.73 () {58 vars in 1275 bytes} [Wed Aug 24 13:42:46 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-interface => generated 285 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:42:48.423156 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-d1a7bf0b-01b7-4626-b164-fb332dd55b61 req-661f0b97-c8e5-406d-aff2-ccc811094ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1b259b6-2024-4b30-865d-17dadaef5406", "tag": "7aadab9f-67a3-4721-a287-269890ea0757"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:42:48.441433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-d1a7bf0b-01b7-4626-b164-fb332dd55b61 req-661f0b97-c8e5-406d-aff2-ccc811094ab6 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:48.442157 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-d1a7bf0b-01b7-4626-b164-fb332dd55b61 req-661f0b97-c8e5-406d-aff2-ccc811094ab6 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:48.442843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-d1a7bf0b-01b7-4626-b164-fb332dd55b61 req-661f0b97-c8e5-406d-aff2-ccc811094ab6 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:48.464202 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-d1a7bf0b-01b7-4626-b164-fb332dd55b61 req-661f0b97-c8e5-406d-aff2-ccc811094ab6 service nova] Creating event network-changed:7aadab9f-67a3-4721-a287-269890ea0757 for instance c1b259b6-2024-4b30-865d-17dadaef5406 on hv-cinder-77957 Aug 24 13:42:48.473083 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-d1a7bf0b-01b7-4626-b164-fb332dd55b61 req-661f0b97-c8e5-406d-aff2-ccc811094ab6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056711 Aug 24 13:42:48.474663 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 286/566] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:42:55.809301 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=4 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:42:55.819654 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-2954e836-f58d-440c-858c-67cf1bad9395 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:55.819654 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-2954e836-f58d-440c-858c-67cf1bad9395 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:55.828893 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2954e836-f58d-440c-858c-67cf1bad9395 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:55.830802 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2954e836-f58d-440c-858c-67cf1bad9395 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:55.831286 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2954e836-f58d-440c-858c-67cf1bad9395 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:55.832025 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2954e836-f58d-440c-858c-67cf1bad9395 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:55.834378 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2954e836-f58d-440c-858c-67cf1bad9395 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:55.834378 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2954e836-f58d-440c-858c-67cf1bad9395 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:55.880035 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-2954e836-f58d-440c-858c-67cf1bad9395 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff/os-volume_attachments/0e9c9554-655b-40b3-9b28-6e8039294353" status: 200 len: 194 microversion: 2.20 time: 0.071557 Aug 24 13:42:55.880929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 281/567] 10.222.0.73 () {60 vars in 1454 bytes} [Wed Aug 24 13:42:55 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff/os-volume_attachments/0e9c9554-655b-40b3-9b28-6e8039294353 => generated 194 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 13:42:55.979662 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-0495a0fa-d260-40f4-9507-54facb5a83ba tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:55.980802 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-0495a0fa-d260-40f4-9507-54facb5a83ba tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:55.987237 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0495a0fa-d260-40f4-9507-54facb5a83ba tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:55.987737 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0495a0fa-d260-40f4-9507-54facb5a83ba tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:55.988194 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0495a0fa-d260-40f4-9507-54facb5a83ba tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:55.988935 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0495a0fa-d260-40f4-9507-54facb5a83ba tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:55.989392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0495a0fa-d260-40f4-9507-54facb5a83ba tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:55.989816 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0495a0fa-d260-40f4-9507-54facb5a83ba tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:56.118137 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.objects.instance [None req-0495a0fa-d260-40f4-9507-54facb5a83ba tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lazy-loading 'services' on Instance uuid 53bade32-e7bf-4ace-9b68-0458f257feff {{(pid=133015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:42:56.375086 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-0495a0fa-d260-40f4-9507-54facb5a83ba tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "DELETE /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff/os-volume_attachments/0e9c9554-655b-40b3-9b28-6e8039294353" status: 202 len: 0 microversion: 2.20 time: 0.400957 Aug 24 13:42:56.376215 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 287/568] 10.222.0.73 () {60 vars in 1457 bytes} [Wed Aug 24 13:42:55 2022] DELETE /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff/os-volume_attachments/0e9c9554-655b-40b3-9b28-6e8039294353 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:42:56.390865 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-4f078558-3391-425b-b130-56f7820532a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:56.395028 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-4f078558-3391-425b-b130-56f7820532a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:56.402964 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4f078558-3391-425b-b130-56f7820532a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:56.403515 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4f078558-3391-425b-b130-56f7820532a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:56.404015 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4f078558-3391-425b-b130-56f7820532a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:56.404864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4f078558-3391-425b-b130-56f7820532a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:56.405472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4f078558-3391-425b-b130-56f7820532a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:56.406056 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4f078558-3391-425b-b130-56f7820532a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:56.453196 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-4f078558-3391-425b-b130-56f7820532a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070016 Aug 24 13:42:56.454315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 282/569] 10.222.0.73 () {60 vars in 1343 bytes} [Wed Aug 24 13:42:56 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 13:42:57.477012 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-7383bed6-d0ac-4f39-8dbd-eed54fd49900 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:57.481046 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-7383bed6-d0ac-4f39-8dbd-eed54fd49900 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:57.490451 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7383bed6-d0ac-4f39-8dbd-eed54fd49900 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:57.490910 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7383bed6-d0ac-4f39-8dbd-eed54fd49900 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:57.491809 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7383bed6-d0ac-4f39-8dbd-eed54fd49900 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:57.493431 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7383bed6-d0ac-4f39-8dbd-eed54fd49900 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:57.494450 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7383bed6-d0ac-4f39-8dbd-eed54fd49900 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:57.495207 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7383bed6-d0ac-4f39-8dbd-eed54fd49900 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:57.533992 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-7383bed6-d0ac-4f39-8dbd-eed54fd49900 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067281 Aug 24 13:42:57.534587 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 288/570] 10.222.0.73 () {60 vars in 1343 bytes} [Wed Aug 24 13:42:57 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 13:42:58.547739 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-f69e3e22-3a4b-4956-87eb-db8a17c8ce51 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:58.550025 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-f69e3e22-3a4b-4956-87eb-db8a17c8ce51 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:58.557236 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f69e3e22-3a4b-4956-87eb-db8a17c8ce51 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:58.557730 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f69e3e22-3a4b-4956-87eb-db8a17c8ce51 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:58.558166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f69e3e22-3a4b-4956-87eb-db8a17c8ce51 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:58.558888 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f69e3e22-3a4b-4956-87eb-db8a17c8ce51 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:58.559334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f69e3e22-3a4b-4956-87eb-db8a17c8ce51 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:58.559757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f69e3e22-3a4b-4956-87eb-db8a17c8ce51 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:58.592387 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-f69e3e22-3a4b-4956-87eb-db8a17c8ce51 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048697 Aug 24 13:42:58.593014 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 283/571] 10.222.0.73 () {60 vars in 1343 bytes} [Wed Aug 24 13:42:58 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:42:58.681998 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d0dee83d-b74e-4353-90d1-2ba8d1e86a20 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:58.682888 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-d0dee83d-b74e-4353-90d1-2ba8d1e86a20 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:58.694391 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d0dee83d-b74e-4353-90d1-2ba8d1e86a20 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:58.695277 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d0dee83d-b74e-4353-90d1-2ba8d1e86a20 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:58.695836 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d0dee83d-b74e-4353-90d1-2ba8d1e86a20 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:58.696726 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d0dee83d-b74e-4353-90d1-2ba8d1e86a20 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:58.697373 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d0dee83d-b74e-4353-90d1-2ba8d1e86a20 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:58.697930 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d0dee83d-b74e-4353-90d1-2ba8d1e86a20 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:58.730346 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-d0dee83d-b74e-4353-90d1-2ba8d1e86a20 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Going to try to terminate instance {{(pid=133015) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 13:42:59.351549 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-d0dee83d-b74e-4353-90d1-2ba8d1e86a20 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "DELETE /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 204 len: 0 microversion: 2.20 time: 0.677457 Aug 24 13:42:59.352161 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 289/572] 10.222.0.73 () {60 vars in 1280 bytes} [Wed Aug 24 13:42:58 2022] DELETE /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 0 bytes in 679 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 13:42:59.361489 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-ba88744b-4b90-46d6-8a45-48f7e945a495 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:42:59.362172 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-ba88744b-4b90-46d6-8a45-48f7e945a495 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:42:59.370252 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ba88744b-4b90-46d6-8a45-48f7e945a495 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:59.370679 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ba88744b-4b90-46d6-8a45-48f7e945a495 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:59.371122 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ba88744b-4b90-46d6-8a45-48f7e945a495 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:59.373907 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ba88744b-4b90-46d6-8a45-48f7e945a495 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:42:59.374538 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ba88744b-4b90-46d6-8a45-48f7e945a495 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:42:59.376546 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ba88744b-4b90-46d6-8a45-48f7e945a495 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:42:59.529869 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-ba88744b-4b90-46d6-8a45-48f7e945a495 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:59.538601 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-ba88744b-4b90-46d6-8a45-48f7e945a495 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:59.540382 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-ba88744b-4b90-46d6-8a45-48f7e945a495 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:42:59.541828 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-ba88744b-4b90-46d6-8a45-48f7e945a495 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1725 microversion: 2.20 time: 0.184514 Aug 24 13:42:59.542401 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 284/573] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:42:59 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:43:00.566997 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d27a81f5-f48f-4e67-bbd0-72485118e0cb tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:00.567709 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-d27a81f5-f48f-4e67-bbd0-72485118e0cb tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:00.574956 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d27a81f5-f48f-4e67-bbd0-72485118e0cb tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:00.575448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d27a81f5-f48f-4e67-bbd0-72485118e0cb tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:00.575889 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d27a81f5-f48f-4e67-bbd0-72485118e0cb tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:00.576643 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d27a81f5-f48f-4e67-bbd0-72485118e0cb tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:00.577193 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d27a81f5-f48f-4e67-bbd0-72485118e0cb tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:00.577641 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d27a81f5-f48f-4e67-bbd0-72485118e0cb tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:00.722510 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d27a81f5-f48f-4e67-bbd0-72485118e0cb tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:00.731150 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d27a81f5-f48f-4e67-bbd0-72485118e0cb tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:00.732721 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d27a81f5-f48f-4e67-bbd0-72485118e0cb tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:00.733891 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-d27a81f5-f48f-4e67-bbd0-72485118e0cb tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1725 microversion: 2.20 time: 0.171514 Aug 24 13:43:00.734452 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 290/574] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:43:00 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:43:01.757913 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-0ec14d98-9747-4b92-889c-c26ad24ebc24 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:01.759098 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-0ec14d98-9747-4b92-889c-c26ad24ebc24 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:01.765663 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0ec14d98-9747-4b92-889c-c26ad24ebc24 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:01.766270 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0ec14d98-9747-4b92-889c-c26ad24ebc24 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:01.766754 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0ec14d98-9747-4b92-889c-c26ad24ebc24 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:01.767518 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0ec14d98-9747-4b92-889c-c26ad24ebc24 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:01.768065 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0ec14d98-9747-4b92-889c-c26ad24ebc24 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:01.768573 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0ec14d98-9747-4b92-889c-c26ad24ebc24 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:01.918241 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0ec14d98-9747-4b92-889c-c26ad24ebc24 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:01.926685 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0ec14d98-9747-4b92-889c-c26ad24ebc24 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:01.928232 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0ec14d98-9747-4b92-889c-c26ad24ebc24 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:01.929394 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-0ec14d98-9747-4b92-889c-c26ad24ebc24 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1725 microversion: 2.20 time: 0.175688 Aug 24 13:43:01.929954 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 285/575] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:43:01 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:43:02.959288 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-aeba4b36-37a5-4236-9e23-119cbcedf21f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:02.960589 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-aeba4b36-37a5-4236-9e23-119cbcedf21f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:02.972878 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aeba4b36-37a5-4236-9e23-119cbcedf21f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:02.973655 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aeba4b36-37a5-4236-9e23-119cbcedf21f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:02.974430 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aeba4b36-37a5-4236-9e23-119cbcedf21f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:02.975684 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aeba4b36-37a5-4236-9e23-119cbcedf21f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:02.976548 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aeba4b36-37a5-4236-9e23-119cbcedf21f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:02.977651 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aeba4b36-37a5-4236-9e23-119cbcedf21f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:03.076109 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-aeba4b36-37a5-4236-9e23-119cbcedf21f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:03.085080 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-aeba4b36-37a5-4236-9e23-119cbcedf21f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:03.086797 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-aeba4b36-37a5-4236-9e23-119cbcedf21f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:03.089290 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-aeba4b36-37a5-4236-9e23-119cbcedf21f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1657 microversion: 2.20 time: 0.137676 Aug 24 13:43:03.089882 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 291/576] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:43:02 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1657 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:43:03.174674 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-cd4dfa0e-b4f5-4da9-8e70-7c0139cef28b req-29ee44ea-a6a7-4e5f-b81d-8f5f70c782d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53bade32-e7bf-4ace-9b68-0458f257feff", "name": "network-vif-deleted", "tag": "55484e25-34c8-469b-8598-d718e9469013"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:43:03.186923 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-cd4dfa0e-b4f5-4da9-8e70-7c0139cef28b req-29ee44ea-a6a7-4e5f-b81d-8f5f70c782d0 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:03.187673 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-cd4dfa0e-b4f5-4da9-8e70-7c0139cef28b req-29ee44ea-a6a7-4e5f-b81d-8f5f70c782d0 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:03.188378 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-cd4dfa0e-b4f5-4da9-8e70-7c0139cef28b req-29ee44ea-a6a7-4e5f-b81d-8f5f70c782d0 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:03.205396 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-cd4dfa0e-b4f5-4da9-8e70-7c0139cef28b req-29ee44ea-a6a7-4e5f-b81d-8f5f70c782d0 service nova] Creating event network-vif-deleted:55484e25-34c8-469b-8598-d718e9469013 for instance 53bade32-e7bf-4ace-9b68-0458f257feff on hv-cinder-77957 Aug 24 13:43:03.211007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-cd4dfa0e-b4f5-4da9-8e70-7c0139cef28b req-29ee44ea-a6a7-4e5f-b81d-8f5f70c782d0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039924 Aug 24 13:43:03.212403 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 286/577] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:43:04.113140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-74a11ab8-d5e5-4087-9f32-aff30ccbd997 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:04.114328 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-74a11ab8-d5e5-4087-9f32-aff30ccbd997 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:04.121348 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-74a11ab8-d5e5-4087-9f32-aff30ccbd997 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:04.122488 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-74a11ab8-d5e5-4087-9f32-aff30ccbd997 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:04.122936 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-74a11ab8-d5e5-4087-9f32-aff30ccbd997 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:04.123664 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-74a11ab8-d5e5-4087-9f32-aff30ccbd997 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:04.124130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-74a11ab8-d5e5-4087-9f32-aff30ccbd997 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:04.124595 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-74a11ab8-d5e5-4087-9f32-aff30ccbd997 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:04.161540 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-74a11ab8-d5e5-4087-9f32-aff30ccbd997 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:04.162033 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-74a11ab8-d5e5-4087-9f32-aff30ccbd997 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:04.162473 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-74a11ab8-d5e5-4087-9f32-aff30ccbd997 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:04.162939 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.objects.instance [None req-74a11ab8-d5e5-4087-9f32-aff30ccbd997 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lazy-loading 'fault' on Instance uuid 53bade32-e7bf-4ace-9b68-0458f257feff {{(pid=133015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:43:04.219494 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-74a11ab8-d5e5-4087-9f32-aff30ccbd997 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:04.231129 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-74a11ab8-d5e5-4087-9f32-aff30ccbd997 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:04.232691 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-74a11ab8-d5e5-4087-9f32-aff30ccbd997 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:04.233898 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-74a11ab8-d5e5-4087-9f32-aff30ccbd997 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 200 len: 1372 microversion: 2.20 time: 0.124644 Aug 24 13:43:04.234769 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 292/578] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:43:04 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 1372 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:43:04.882908 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-7b994947-e9e9-46fd-95f7-547b3428cf94 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1224245826", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-797259511", "security_groups": [{"name": "tempest-secgroup-smoke-856119561"}], "block_device_mapping_v2": [{"uuid": "5c06e37d-1016-4f82-a553-5d1fa159c3d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "440bd507-b6ac-4736-a4d2-ede05189225c"}]}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:43:05.033479 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.network.neutron [None req-7b994947-e9e9-46fd-95f7-547b3428cf94 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] validate_networks() for [('440bd507-b6ac-4736-a4d2-ede05189225c', None, None, None, None, None)] {{(pid=133014) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:43:05.269322 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-98eeb0ea-a25a-47e3-aeca-d7f2cf0a07b9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:05.269946 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-98eeb0ea-a25a-47e3-aeca-d7f2cf0a07b9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:05.277217 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-98eeb0ea-a25a-47e3-aeca-d7f2cf0a07b9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:05.277701 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-98eeb0ea-a25a-47e3-aeca-d7f2cf0a07b9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:05.278135 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-98eeb0ea-a25a-47e3-aeca-d7f2cf0a07b9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:05.278831 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-98eeb0ea-a25a-47e3-aeca-d7f2cf0a07b9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:05.279569 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-98eeb0ea-a25a-47e3-aeca-d7f2cf0a07b9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:05.279700 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-98eeb0ea-a25a-47e3-aeca-d7f2cf0a07b9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:05.294123 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.wsgi [None req-98eeb0ea-a25a-47e3-aeca-d7f2cf0a07b9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] HTTP exception thrown: Instance 53bade32-e7bf-4ace-9b68-0458f257feff could not be found. Aug 24 13:43:05.295768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-98eeb0ea-a25a-47e3-aeca-d7f2cf0a07b9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Request method failure captured: Aug 24 13:43:05.295768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff HTTP/1.1 Aug 24 13:43:05.295768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:43:05.295768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:43:05.295768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:43:05.295768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 0 Aug 24 13:43:05.295768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:43:05.295768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:43:05.295768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:43:05.295768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:43:05.295768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBinWpOk7vD7uAwOZuIB6_DAzYh_0hcgP0zPNptvzinwWHzkIeNkrRr4Zoy0a3D10KctxnVwVtCdpCsH-hkQHSYN5wyp9fGVh-j6-Ts_oux84dFh7xqQCAh8qjlIeC4ED_c9aHc_CIi9Wdacj1ETZHFHn6xsJWdObx9IaiVl-5EE7L64 Aug 24 13:43:05.295768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:43:05.295768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:43:05.295768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:43:05.295768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:43:05.295768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 13:43:05.295768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:43:05.295768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:43:05.295768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: 4a3794670e8d4c9985547d557d6969e0 Aug 24 13:43:05.295768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1315367245 Aug 24 13:43:05.295768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:43:05.295768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:43:05.297265 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4a3794670e8d4c9985547d557d6969e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4a3794670e8d4c9985547d557d6969e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4a3794670e8d4c9985547d557d6969e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4a3794670e8d4c9985547d557d6969e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:43:05.297265 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1315367245 Aug 24 13:43:05.297265 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: 4a3794670e8d4c9985547d557d6969e0 Aug 24 13:43:05.297265 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1315367245 Aug 24 13:43:05.297265 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-AttachVolumeShelveTestJSON-1315367245-project Aug 24 13:43:05.297265 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:43:05.297265 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:43:05.297265 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: 773dc87736034257b3d1ae2e8f02bf23 Aug 24 13:43:05.297265 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1315367245-project Aug 24 13:43:05.297265 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: > Aug 24 13:43:05.297265 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Instance 53bade32-e7bf-4ace-9b68-0458f257feff could not be found. Aug 24 13:43:05.297265 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'id': '53bade32-e7bf-4ace-9b68-0458f257feff'} Aug 24 13:43:05.298995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:43:05.298995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:43:05.298995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:43:05.298995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:43:05.298995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:43:05.298995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:43:05.298995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:43:05.298995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:43:05.298995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:43:05.298995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:43:05.298995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53bade32-e7bf-4ace-9b68-0458f257feff could not be found. Aug 24 13:43:05.298995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:43:05.298995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:43:05.298995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:43:05.298995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:43:05.298995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:43:05.298995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:43:05.298995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:43:05.298995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:43:05.298995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:43:05.300958 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:43:05.300958 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:43:05.300958 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:43:05.300958 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:43:05.300958 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:43:05.300958 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:43:05.300958 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:43:05.300958 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53bade32-e7bf-4ace-9b68-0458f257feff could not be found. Aug 24 13:43:05.300958 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:43:05.300958 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:43:05.300958 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:43:05.300958 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:43:05.300958 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:43:05.300958 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:43:05.300958 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:43:05.300958 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:43:05.300958 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53bade32-e7bf-4ace-9b68-0458f257feff could not be found. Aug 24 13:43:05.300958 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:43:05.302489 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-98eeb0ea-a25a-47e3-aeca-d7f2cf0a07b9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Returning 404 to user: Instance 53bade32-e7bf-4ace-9b68-0458f257feff could not be found. {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:43:05.302489 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-98eeb0ea-a25a-47e3-aeca-d7f2cf0a07b9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 404 len: 111 microversion: 2.20 time: 0.031874 Aug 24 13:43:05.302489 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 293/579] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:43:05 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 13:43:05.306775 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d92867a8-33c2-4466-95e9-44d51f918512 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '.version_select at 0x7f96c20da430>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:05.420953 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-d92867a8-33c2-4466-95e9-44d51f918512 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1682784562" status: 204 len: 0 microversion: 2.20 time: 0.118316 Aug 24 13:43:05.421548 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 294/580] 10.222.0.73 () {60 vars in 1262 bytes} [Wed Aug 24 13:43:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1682784562 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 13:43:05.461563 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-7b994947-e9e9-46fd-95f7-547b3428cf94 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Flavor limits 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:43:05.462669 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-7b994947-e9e9-46fd-95f7-547b3428cf94 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Image limits 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:43:05.462944 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-7b994947-e9e9-46fd-95f7-547b3428cf94 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Flavor pref 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:43:05.463654 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-7b994947-e9e9-46fd-95f7-547b3428cf94 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Image pref 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:43:05.464496 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-7b994947-e9e9-46fd-95f7-547b3428cf94 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:43:05.478706 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7b994947-e9e9-46fd-95f7-547b3428cf94 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:05.479290 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7b994947-e9e9-46fd-95f7-547b3428cf94 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:05.479855 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7b994947-e9e9-46fd-95f7-547b3428cf94 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:05.480746 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7b994947-e9e9-46fd-95f7-547b3428cf94 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:05.481293 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7b994947-e9e9-46fd-95f7-547b3428cf94 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:05.481856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7b994947-e9e9-46fd-95f7-547b3428cf94 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:05.503637 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-7b994947-e9e9-46fd-95f7-547b3428cf94 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Getting quotas for project 6842f55d3dcc42289b6bfe02ed020dc4. Resources: {'instances', 'cores', 'ram'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:43:05.508110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-7b994947-e9e9-46fd-95f7-547b3428cf94 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Getting quotas for user 98b30f0436864263b2829921f212f8ce and project 6842f55d3dcc42289b6bfe02ed020dc4. Resources: {'instances', 'cores', 'ram'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:43:05.572606 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-7b994947-e9e9-46fd-95f7-547b3428cf94 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Going to run 1 instances... {{(pid=133014) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 13:43:05.574981 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-7b994947-e9e9-46fd-95f7-547b3428cf94 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5c06e37d-1016-4f82-a553-5d1fa159c3d8',volume_size=None,volume_type=None)] {{(pid=133014) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 13:43:05.907490 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:43:06.051386 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-7b994947-e9e9-46fd-95f7-547b3428cf94 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.174687 Aug 24 13:43:06.058286 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 287/581] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 13:43:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 13:43:06.064209 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-be4561ac-63d7-4e7c-85b7-ec74e0a57ecd tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:06.065002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-be4561ac-63d7-4e7c-85b7-ec74e0a57ecd tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:06.146148 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-be4561ac-63d7-4e7c-85b7-ec74e0a57ecd tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:06.155455 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-be4561ac-63d7-4e7c-85b7-ec74e0a57ecd tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 200 len: 1094 microversion: 2.1 time: 0.095751 Aug 24 13:43:06.156817 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 295/582] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:06 2022] GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 1094 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:43:06.298584 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-c01d7f49-c8ee-40e6-8586-d947b272f377 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Action: 'create', calling method: .version_select at 0x7f96c2b6c160>, body: {"keypair": {"name": "tempest-keypair-480623443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGE1d8UhvG3jpJL3jVAWii822Y01DLm0PlmzW97rLbM4LAJgiUBbp4lWQU7yrKlABi3Pzec4SjYSm3NX0KOOge8BLb2Vmq8R9DW36ZjxXNGAx8qVvEbW4MRlt/llfDwZag=="}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:43:06.315684 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-c01d7f49-c8ee-40e6-8586-d947b272f377 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Getting quotas for project 4a3794670e8d4c9985547d557d6969e0. Resources: {'key_pairs'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:43:06.319974 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-c01d7f49-c8ee-40e6-8586-d947b272f377 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Getting quotas for user 773dc87736034257b3d1ae2e8f02bf23 and project 4a3794670e8d4c9985547d557d6969e0. Resources: {'key_pairs'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:43:06.439238 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-c01d7f49-c8ee-40e6-8586-d947b272f377 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.144651 Aug 24 13:43:06.439774 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 288/583] 10.222.0.73 () {62 vars in 1200 bytes} [Wed Aug 24 13:43:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 146 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 13:43:07.179600 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-cae30810-4b91-42ce-8b56-ac9aa0aac6f2 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:07.180835 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-cae30810-4b91-42ce-8b56-ac9aa0aac6f2 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:07.238023 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-cae30810-4b91-42ce-8b56-ac9aa0aac6f2 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:07.245866 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-cae30810-4b91-42ce-8b56-ac9aa0aac6f2 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 200 len: 1094 microversion: 2.1 time: 0.071501 Aug 24 13:43:07.246447 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 296/584] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:07 2022] GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:43:08.267266 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-2bacf1d7-c732-4efc-8026-4c73b589aaed tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:08.267944 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-2bacf1d7-c732-4efc-8026-4c73b589aaed tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:08.274677 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2bacf1d7-c732-4efc-8026-4c73b589aaed tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:08.281844 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2bacf1d7-c732-4efc-8026-4c73b589aaed tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:08.281844 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2bacf1d7-c732-4efc-8026-4c73b589aaed tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:08.281844 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2bacf1d7-c732-4efc-8026-4c73b589aaed tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:08.281844 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2bacf1d7-c732-4efc-8026-4c73b589aaed tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:08.282467 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2bacf1d7-c732-4efc-8026-4c73b589aaed tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:08.282467 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=75 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:43:08.354226 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-2bacf1d7-c732-4efc-8026-4c73b589aaed tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:08.362049 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-2bacf1d7-c732-4efc-8026-4c73b589aaed tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 200 len: 1192 microversion: 2.1 time: 0.098870 Aug 24 13:43:08.362618 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 289/585] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:08 2022] GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 1192 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:43:09.094460 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-4064ebea-59bc-49ca-b2b8-718813b42e90 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1312142011", "imageRef": "c520113c-3dae-4490-98bb-19fe3a46b66d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "385fd5c5-6c70-4a95-9981-8683550b730c"}], "security_groups": [{"name": "tempest-securitygroup--1976106336"}], "key_name": "tempest-keypair-480623443", "user_data": "}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:43:09.271553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.network.neutron [None req-4064ebea-59bc-49ca-b2b8-718813b42e90 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] validate_networks() for [('385fd5c5-6c70-4a95-9981-8683550b730c', None, None, None, None, None)] {{(pid=133015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:43:09.383065 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-31f4fda0-5043-464b-b77b-21d987a4f0ca tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:09.384475 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-31f4fda0-5043-464b-b77b-21d987a4f0ca tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:09.391310 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-31f4fda0-5043-464b-b77b-21d987a4f0ca tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:09.391803 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-31f4fda0-5043-464b-b77b-21d987a4f0ca tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:09.392260 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-31f4fda0-5043-464b-b77b-21d987a4f0ca tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:09.392956 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-31f4fda0-5043-464b-b77b-21d987a4f0ca tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:09.393405 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-31f4fda0-5043-464b-b77b-21d987a4f0ca tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:09.393825 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-31f4fda0-5043-464b-b77b-21d987a4f0ca tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:09.507560 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-31f4fda0-5043-464b-b77b-21d987a4f0ca tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:09.516460 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-31f4fda0-5043-464b-b77b-21d987a4f0ca tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 200 len: 1210 microversion: 2.1 time: 0.137297 Aug 24 13:43:09.517046 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 290/586] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:09 2022] GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 1210 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:43:10.165661 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-4064ebea-59bc-49ca-b2b8-718813b42e90 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Flavor limits 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:43:10.168385 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-4064ebea-59bc-49ca-b2b8-718813b42e90 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Image limits 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:43:10.168385 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-4064ebea-59bc-49ca-b2b8-718813b42e90 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Flavor pref 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:43:10.168385 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-4064ebea-59bc-49ca-b2b8-718813b42e90 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Image pref 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:43:10.168385 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-4064ebea-59bc-49ca-b2b8-718813b42e90 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:43:10.182133 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4064ebea-59bc-49ca-b2b8-718813b42e90 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:10.182932 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4064ebea-59bc-49ca-b2b8-718813b42e90 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:10.183543 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4064ebea-59bc-49ca-b2b8-718813b42e90 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:10.184473 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4064ebea-59bc-49ca-b2b8-718813b42e90 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:10.185050 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4064ebea-59bc-49ca-b2b8-718813b42e90 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:10.185519 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4064ebea-59bc-49ca-b2b8-718813b42e90 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:10.193696 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:43:10.205906 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-4064ebea-59bc-49ca-b2b8-718813b42e90 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Getting quotas for project 4a3794670e8d4c9985547d557d6969e0. Resources: {'instances', 'cores', 'ram'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:43:10.211039 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-4064ebea-59bc-49ca-b2b8-718813b42e90 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Getting quotas for user 773dc87736034257b3d1ae2e8f02bf23 and project 4a3794670e8d4c9985547d557d6969e0. Resources: {'instances', 'cores', 'ram'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:43:10.223135 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-4064ebea-59bc-49ca-b2b8-718813b42e90 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Going to run 1 instances... {{(pid=133015) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 13:43:10.225545 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-4064ebea-59bc-49ca-b2b8-718813b42e90 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c520113c-3dae-4490-98bb-19fe3a46b66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 13:43:10.346973 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-4064ebea-59bc-49ca-b2b8-718813b42e90 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.256943 Aug 24 13:43:10.348023 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 297/587] 10.222.0.73 () {62 vars in 1188 bytes} [Wed Aug 24 13:43:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 1258 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 13:43:10.359985 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-60993703-5d34-4476-83cc-2e134c94e8f4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:10.361053 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-60993703-5d34-4476-83cc-2e134c94e8f4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:10.476563 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-60993703-5d34-4476-83cc-2e134c94e8f4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:10.496718 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-60993703-5d34-4476-83cc-2e134c94e8f4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:10.507823 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-60993703-5d34-4476-83cc-2e134c94e8f4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:10.509528 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-60993703-5d34-4476-83cc-2e134c94e8f4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1281 microversion: 2.20 time: 0.153738 Aug 24 13:43:10.510299 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 291/588] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:43:10 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1281 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:43:10.544553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-1e0b41ec-d7d8-48e3-916e-0bf9ed4c541c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:10.544553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-1e0b41ec-d7d8-48e3-916e-0bf9ed4c541c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:10.549388 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1e0b41ec-d7d8-48e3-916e-0bf9ed4c541c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:10.549885 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1e0b41ec-d7d8-48e3-916e-0bf9ed4c541c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:10.550319 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1e0b41ec-d7d8-48e3-916e-0bf9ed4c541c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:10.551290 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1e0b41ec-d7d8-48e3-916e-0bf9ed4c541c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:10.551724 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1e0b41ec-d7d8-48e3-916e-0bf9ed4c541c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:10.552144 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1e0b41ec-d7d8-48e3-916e-0bf9ed4c541c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:10.755344 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-1e0b41ec-d7d8-48e3-916e-0bf9ed4c541c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:10.762945 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-1e0b41ec-d7d8-48e3-916e-0bf9ed4c541c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 200 len: 1277 microversion: 2.1 time: 0.228937 Aug 24 13:43:10.763534 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 298/589] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:10 2022] GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 1277 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:43:11.140444 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-3b4abbff-74fc-4ef1-bb05-48c45f311cc1 req-7af7de6d-2dc5-4454-ab2e-c06b5d9877da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d89846c9-96d3-4b1b-bba0-bc5d89c6bbde", "tag": "a8cb0618-6a5e-42d2-b95f-2fbf7a391e9a"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:43:11.151968 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-3b4abbff-74fc-4ef1-bb05-48c45f311cc1 req-7af7de6d-2dc5-4454-ab2e-c06b5d9877da service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:11.152626 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-3b4abbff-74fc-4ef1-bb05-48c45f311cc1 req-7af7de6d-2dc5-4454-ab2e-c06b5d9877da service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:11.153249 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-3b4abbff-74fc-4ef1-bb05-48c45f311cc1 req-7af7de6d-2dc5-4454-ab2e-c06b5d9877da service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:11.172950 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-3b4abbff-74fc-4ef1-bb05-48c45f311cc1 req-7af7de6d-2dc5-4454-ab2e-c06b5d9877da service nova] Creating event network-changed:a8cb0618-6a5e-42d2-b95f-2fbf7a391e9a for instance d89846c9-96d3-4b1b-bba0-bc5d89c6bbde on hv-cinder-77957 Aug 24 13:43:11.172950 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-3b4abbff-74fc-4ef1-bb05-48c45f311cc1 req-7af7de6d-2dc5-4454-ab2e-c06b5d9877da service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033320 Aug 24 13:43:11.172950 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 292/590] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:43:11.537011 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-bd6c16bb-8cfc-4c69-866c-a5fd6a4d8366 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:11.537825 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-bd6c16bb-8cfc-4c69-866c-a5fd6a4d8366 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:11.544521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bd6c16bb-8cfc-4c69-866c-a5fd6a4d8366 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:11.545007 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bd6c16bb-8cfc-4c69-866c-a5fd6a4d8366 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:11.545436 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bd6c16bb-8cfc-4c69-866c-a5fd6a4d8366 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:11.546128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bd6c16bb-8cfc-4c69-866c-a5fd6a4d8366 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:11.546578 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bd6c16bb-8cfc-4c69-866c-a5fd6a4d8366 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:11.550932 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bd6c16bb-8cfc-4c69-866c-a5fd6a4d8366 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:11.627001 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-bd6c16bb-8cfc-4c69-866c-a5fd6a4d8366 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:11.635496 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-bd6c16bb-8cfc-4c69-866c-a5fd6a4d8366 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:11.637051 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-bd6c16bb-8cfc-4c69-866c-a5fd6a4d8366 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:11.638179 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-bd6c16bb-8cfc-4c69-866c-a5fd6a4d8366 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1285 microversion: 2.20 time: 0.105192 Aug 24 13:43:11.638743 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 299/591] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:43:11 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:43:11.783571 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-954dee12-aeae-47d4-8939-d0daee10a2c6 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:11.784475 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-954dee12-aeae-47d4-8939-d0daee10a2c6 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:11.791154 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-954dee12-aeae-47d4-8939-d0daee10a2c6 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:11.793285 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-954dee12-aeae-47d4-8939-d0daee10a2c6 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:11.793285 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-954dee12-aeae-47d4-8939-d0daee10a2c6 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:11.793285 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-954dee12-aeae-47d4-8939-d0daee10a2c6 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:11.793285 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-954dee12-aeae-47d4-8939-d0daee10a2c6 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:11.793632 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-954dee12-aeae-47d4-8939-d0daee10a2c6 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:12.012297 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-954dee12-aeae-47d4-8939-d0daee10a2c6 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:12.020253 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-954dee12-aeae-47d4-8939-d0daee10a2c6 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 200 len: 1265 microversion: 2.1 time: 0.240974 Aug 24 13:43:12.021031 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 293/592] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:11 2022] GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:43:12.662113 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b8a2418a-3531-477b-9222-8c575ac05bc6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:12.662765 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b8a2418a-3531-477b-9222-8c575ac05bc6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:12.665085 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:43:12.671431 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b8a2418a-3531-477b-9222-8c575ac05bc6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:12.675594 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b8a2418a-3531-477b-9222-8c575ac05bc6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:12.675594 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b8a2418a-3531-477b-9222-8c575ac05bc6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:12.675594 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b8a2418a-3531-477b-9222-8c575ac05bc6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:12.675594 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b8a2418a-3531-477b-9222-8c575ac05bc6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:12.675971 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b8a2418a-3531-477b-9222-8c575ac05bc6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:12.810398 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b8a2418a-3531-477b-9222-8c575ac05bc6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:12.819914 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b8a2418a-3531-477b-9222-8c575ac05bc6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:12.821480 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b8a2418a-3531-477b-9222-8c575ac05bc6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:12.822893 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b8a2418a-3531-477b-9222-8c575ac05bc6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1341 microversion: 2.20 time: 0.164787 Aug 24 13:43:12.823472 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 300/593] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:43:12 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1341 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:43:13.042706 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-b4d79fc6-4260-4274-b586-4f733ae523d1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:13.043338 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-b4d79fc6-4260-4274-b586-4f733ae523d1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:13.049697 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b4d79fc6-4260-4274-b586-4f733ae523d1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:13.050194 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b4d79fc6-4260-4274-b586-4f733ae523d1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:13.050630 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b4d79fc6-4260-4274-b586-4f733ae523d1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:13.051337 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b4d79fc6-4260-4274-b586-4f733ae523d1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:13.051993 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b4d79fc6-4260-4274-b586-4f733ae523d1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:13.052453 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b4d79fc6-4260-4274-b586-4f733ae523d1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:13.221507 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-b4d79fc6-4260-4274-b586-4f733ae523d1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:13.233918 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-b4d79fc6-4260-4274-b586-4f733ae523d1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 200 len: 1265 microversion: 2.1 time: 0.194839 Aug 24 13:43:13.234555 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 294/594] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:13 2022] GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:43:13.851857 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-39ce963c-e96a-4f3a-8ea0-926861215910 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:13.853975 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-39ce963c-e96a-4f3a-8ea0-926861215910 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:13.862254 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-39ce963c-e96a-4f3a-8ea0-926861215910 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:13.863065 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-39ce963c-e96a-4f3a-8ea0-926861215910 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:13.863574 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-39ce963c-e96a-4f3a-8ea0-926861215910 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:13.864519 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-39ce963c-e96a-4f3a-8ea0-926861215910 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:13.864985 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-39ce963c-e96a-4f3a-8ea0-926861215910 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:13.865433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-39ce963c-e96a-4f3a-8ea0-926861215910 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:14.079624 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-39ce963c-e96a-4f3a-8ea0-926861215910 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:14.089046 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-39ce963c-e96a-4f3a-8ea0-926861215910 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:14.090682 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-39ce963c-e96a-4f3a-8ea0-926861215910 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:14.092013 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-39ce963c-e96a-4f3a-8ea0-926861215910 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1407 microversion: 2.20 time: 0.246067 Aug 24 13:43:14.092684 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 301/595] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:43:13 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:43:14.266410 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-b7291e4e-752e-4b76-bccb-fd31bb1b7b57 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:14.269462 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-b7291e4e-752e-4b76-bccb-fd31bb1b7b57 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:14.276814 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b7291e4e-752e-4b76-bccb-fd31bb1b7b57 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:14.277340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b7291e4e-752e-4b76-bccb-fd31bb1b7b57 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:14.277778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b7291e4e-752e-4b76-bccb-fd31bb1b7b57 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:14.278503 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b7291e4e-752e-4b76-bccb-fd31bb1b7b57 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:14.278961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b7291e4e-752e-4b76-bccb-fd31bb1b7b57 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:14.279386 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b7291e4e-752e-4b76-bccb-fd31bb1b7b57 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:14.468969 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-b7291e4e-752e-4b76-bccb-fd31bb1b7b57 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:14.477043 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-b7291e4e-752e-4b76-bccb-fd31bb1b7b57 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 200 len: 1265 microversion: 2.1 time: 0.220932 Aug 24 13:43:14.477691 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 295/596] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:14 2022] GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:43:14.838121 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-afa58fe1-0e84-49ef-8203-30ec6c26d010 req-1d7ed4b1-cfe6-4a8b-ba6e-1738d780c5ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac19de18-372a-4cb9-bb59-0cb4b15e80b4", "tag": "a11fdd6d-daa9-44f9-b1cc-eeb70dbbd497"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:43:14.852358 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-afa58fe1-0e84-49ef-8203-30ec6c26d010 req-1d7ed4b1-cfe6-4a8b-ba6e-1738d780c5ac service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:14.853590 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-afa58fe1-0e84-49ef-8203-30ec6c26d010 req-1d7ed4b1-cfe6-4a8b-ba6e-1738d780c5ac service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:14.853765 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-afa58fe1-0e84-49ef-8203-30ec6c26d010 req-1d7ed4b1-cfe6-4a8b-ba6e-1738d780c5ac service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:14.865549 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-afa58fe1-0e84-49ef-8203-30ec6c26d010 req-1d7ed4b1-cfe6-4a8b-ba6e-1738d780c5ac service nova] Creating event network-changed:a11fdd6d-daa9-44f9-b1cc-eeb70dbbd497 for instance ac19de18-372a-4cb9-bb59-0cb4b15e80b4 on hv-cinder-77957 Aug 24 13:43:14.871964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-afa58fe1-0e84-49ef-8203-30ec6c26d010 req-1d7ed4b1-cfe6-4a8b-ba6e-1738d780c5ac service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040218 Aug 24 13:43:14.872834 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 302/597] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:43:15.121325 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-13bdfe3d-4ae9-44f1-a7eb-1719e698891f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:15.121325 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-13bdfe3d-4ae9-44f1-a7eb-1719e698891f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:15.124072 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-13bdfe3d-4ae9-44f1-a7eb-1719e698891f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:15.124600 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-13bdfe3d-4ae9-44f1-a7eb-1719e698891f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:15.125050 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-13bdfe3d-4ae9-44f1-a7eb-1719e698891f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:15.125844 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-13bdfe3d-4ae9-44f1-a7eb-1719e698891f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:15.126308 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-13bdfe3d-4ae9-44f1-a7eb-1719e698891f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:15.126738 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-13bdfe3d-4ae9-44f1-a7eb-1719e698891f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:15.357885 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-13bdfe3d-4ae9-44f1-a7eb-1719e698891f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:15.366960 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-13bdfe3d-4ae9-44f1-a7eb-1719e698891f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:15.368510 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-13bdfe3d-4ae9-44f1-a7eb-1719e698891f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:15.369643 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-13bdfe3d-4ae9-44f1-a7eb-1719e698891f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1407 microversion: 2.20 time: 0.257631 Aug 24 13:43:15.370206 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 296/598] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:43:15 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:43:15.497917 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-3b672517-7b8c-49b4-813f-50f919f6a8c6 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:15.498610 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-3b672517-7b8c-49b4-813f-50f919f6a8c6 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:15.506455 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3b672517-7b8c-49b4-813f-50f919f6a8c6 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:15.507004 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3b672517-7b8c-49b4-813f-50f919f6a8c6 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:15.507397 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3b672517-7b8c-49b4-813f-50f919f6a8c6 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:15.508099 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3b672517-7b8c-49b4-813f-50f919f6a8c6 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:15.508682 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3b672517-7b8c-49b4-813f-50f919f6a8c6 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:15.509069 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3b672517-7b8c-49b4-813f-50f919f6a8c6 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:15.753740 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-3b672517-7b8c-49b4-813f-50f919f6a8c6 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:15.765263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-3b672517-7b8c-49b4-813f-50f919f6a8c6 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 200 len: 1265 microversion: 2.1 time: 0.271377 Aug 24 13:43:15.766207 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 303/599] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:15 2022] GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 1265 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:43:16.393438 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a475f34f-f376-4f48-9ad5-468bdb7682d6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:16.394055 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a475f34f-f376-4f48-9ad5-468bdb7682d6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:16.396019 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=2 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:43:16.401690 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a475f34f-f376-4f48-9ad5-468bdb7682d6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:16.402208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a475f34f-f376-4f48-9ad5-468bdb7682d6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:16.402835 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a475f34f-f376-4f48-9ad5-468bdb7682d6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:16.403605 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a475f34f-f376-4f48-9ad5-468bdb7682d6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:16.404091 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a475f34f-f376-4f48-9ad5-468bdb7682d6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:16.404595 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a475f34f-f376-4f48-9ad5-468bdb7682d6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:16.542875 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a475f34f-f376-4f48-9ad5-468bdb7682d6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:16.551404 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a475f34f-f376-4f48-9ad5-468bdb7682d6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:16.552987 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a475f34f-f376-4f48-9ad5-468bdb7682d6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:16.554094 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a475f34f-f376-4f48-9ad5-468bdb7682d6 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1407 microversion: 2.20 time: 0.164680 Aug 24 13:43:16.554657 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 297/600] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:43:16 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:43:16.787051 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-5f6a4603-d72d-4532-a708-918dd6e8f430 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:16.787662 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-5f6a4603-d72d-4532-a708-918dd6e8f430 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:16.795144 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5f6a4603-d72d-4532-a708-918dd6e8f430 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:16.795637 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5f6a4603-d72d-4532-a708-918dd6e8f430 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:16.796072 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5f6a4603-d72d-4532-a708-918dd6e8f430 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:16.796799 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5f6a4603-d72d-4532-a708-918dd6e8f430 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:16.797255 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5f6a4603-d72d-4532-a708-918dd6e8f430 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:16.797683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5f6a4603-d72d-4532-a708-918dd6e8f430 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:16.933878 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-5f6a4603-d72d-4532-a708-918dd6e8f430 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:16.942335 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-5f6a4603-d72d-4532-a708-918dd6e8f430 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 200 len: 1265 microversion: 2.1 time: 0.159226 Aug 24 13:43:16.942957 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 304/601] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:16 2022] GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:43:17.580268 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-02383d88-5ab5-496d-a5c2-09efe70295e4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:17.581073 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-02383d88-5ab5-496d-a5c2-09efe70295e4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:17.587224 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-02383d88-5ab5-496d-a5c2-09efe70295e4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:17.587752 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-02383d88-5ab5-496d-a5c2-09efe70295e4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:17.588227 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-02383d88-5ab5-496d-a5c2-09efe70295e4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:17.588958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-02383d88-5ab5-496d-a5c2-09efe70295e4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:17.589426 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-02383d88-5ab5-496d-a5c2-09efe70295e4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:17.589853 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-02383d88-5ab5-496d-a5c2-09efe70295e4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:17.743991 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-02383d88-5ab5-496d-a5c2-09efe70295e4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:17.753574 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-02383d88-5ab5-496d-a5c2-09efe70295e4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:17.764853 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-02383d88-5ab5-496d-a5c2-09efe70295e4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:17.767079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-02383d88-5ab5-496d-a5c2-09efe70295e4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1407 microversion: 2.20 time: 0.190811 Aug 24 13:43:17.767659 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 298/602] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:43:17 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:43:17.963014 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-29101721-8f2f-405f-af5e-e9f5ed176463 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:17.964035 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-29101721-8f2f-405f-af5e-e9f5ed176463 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:17.970404 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-29101721-8f2f-405f-af5e-e9f5ed176463 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:17.970887 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-29101721-8f2f-405f-af5e-e9f5ed176463 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:17.971325 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-29101721-8f2f-405f-af5e-e9f5ed176463 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:17.972029 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-29101721-8f2f-405f-af5e-e9f5ed176463 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:17.972520 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-29101721-8f2f-405f-af5e-e9f5ed176463 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:17.972977 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-29101721-8f2f-405f-af5e-e9f5ed176463 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:18.109149 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-29101721-8f2f-405f-af5e-e9f5ed176463 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:18.117228 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-29101721-8f2f-405f-af5e-e9f5ed176463 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 200 len: 1265 microversion: 2.1 time: 0.158058 Aug 24 13:43:18.117839 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 305/603] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:17 2022] GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:43:18.790440 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-cc942593-c3ad-4a74-9b50-1a5ea5e1b946 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:18.791166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-cc942593-c3ad-4a74-9b50-1a5ea5e1b946 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:18.798324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cc942593-c3ad-4a74-9b50-1a5ea5e1b946 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:18.798819 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cc942593-c3ad-4a74-9b50-1a5ea5e1b946 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:18.799257 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cc942593-c3ad-4a74-9b50-1a5ea5e1b946 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:18.799969 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cc942593-c3ad-4a74-9b50-1a5ea5e1b946 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:18.800477 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cc942593-c3ad-4a74-9b50-1a5ea5e1b946 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:18.800928 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cc942593-c3ad-4a74-9b50-1a5ea5e1b946 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:18.968641 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-cc942593-c3ad-4a74-9b50-1a5ea5e1b946 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:18.977505 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-cc942593-c3ad-4a74-9b50-1a5ea5e1b946 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:18.980000 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-cc942593-c3ad-4a74-9b50-1a5ea5e1b946 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:18.981199 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-cc942593-c3ad-4a74-9b50-1a5ea5e1b946 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1407 microversion: 2.20 time: 0.194848 Aug 24 13:43:18.981759 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 299/604] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:43:18 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:43:19.138704 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-aa5c7e88-a3d2-47e3-875b-78c087aa09c7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:19.139320 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-aa5c7e88-a3d2-47e3-875b-78c087aa09c7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:19.145825 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aa5c7e88-a3d2-47e3-875b-78c087aa09c7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:19.146310 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aa5c7e88-a3d2-47e3-875b-78c087aa09c7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:19.146748 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aa5c7e88-a3d2-47e3-875b-78c087aa09c7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:19.147442 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aa5c7e88-a3d2-47e3-875b-78c087aa09c7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:19.147901 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aa5c7e88-a3d2-47e3-875b-78c087aa09c7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:19.148429 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aa5c7e88-a3d2-47e3-875b-78c087aa09c7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:19.293281 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-aa5c7e88-a3d2-47e3-875b-78c087aa09c7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:19.306721 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-aa5c7e88-a3d2-47e3-875b-78c087aa09c7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 200 len: 1265 microversion: 2.1 time: 0.171742 Aug 24 13:43:19.307769 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 306/605] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:19 2022] GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:43:20.005540 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-0e2b6b60-2ac0-4a0a-aefe-c0cba3062bd7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:20.006155 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-0e2b6b60-2ac0-4a0a-aefe-c0cba3062bd7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:20.013140 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0e2b6b60-2ac0-4a0a-aefe-c0cba3062bd7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:20.013627 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0e2b6b60-2ac0-4a0a-aefe-c0cba3062bd7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:20.014060 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0e2b6b60-2ac0-4a0a-aefe-c0cba3062bd7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:20.014759 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0e2b6b60-2ac0-4a0a-aefe-c0cba3062bd7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:20.015204 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0e2b6b60-2ac0-4a0a-aefe-c0cba3062bd7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:20.015845 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0e2b6b60-2ac0-4a0a-aefe-c0cba3062bd7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:20.048416 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-ed432d49-e596-48c7-9ec4-89693a36d19a req-59af8e0a-92ed-49b2-aff9-f12e1429600a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac19de18-372a-4cb9-bb59-0cb4b15e80b4", "name": "network-vif-plugged", "status": "completed", "tag": "a11fdd6d-daa9-44f9-b1cc-eeb70dbbd497"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:43:20.061378 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-ed432d49-e596-48c7-9ec4-89693a36d19a req-59af8e0a-92ed-49b2-aff9-f12e1429600a service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:20.061378 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-ed432d49-e596-48c7-9ec4-89693a36d19a req-59af8e0a-92ed-49b2-aff9-f12e1429600a service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:20.063192 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-ed432d49-e596-48c7-9ec4-89693a36d19a req-59af8e0a-92ed-49b2-aff9-f12e1429600a service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:20.076360 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-ed432d49-e596-48c7-9ec4-89693a36d19a req-59af8e0a-92ed-49b2-aff9-f12e1429600a service nova] Creating event network-vif-plugged:a11fdd6d-daa9-44f9-b1cc-eeb70dbbd497 for instance ac19de18-372a-4cb9-bb59-0cb4b15e80b4 on hv-cinder-77957 Aug 24 13:43:20.082017 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-ed432d49-e596-48c7-9ec4-89693a36d19a req-59af8e0a-92ed-49b2-aff9-f12e1429600a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037273 Aug 24 13:43:20.082905 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 307/606] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:43:20.179776 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0e2b6b60-2ac0-4a0a-aefe-c0cba3062bd7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:20.189685 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0e2b6b60-2ac0-4a0a-aefe-c0cba3062bd7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:20.191249 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0e2b6b60-2ac0-4a0a-aefe-c0cba3062bd7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:20.192451 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-0e2b6b60-2ac0-4a0a-aefe-c0cba3062bd7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1407 microversion: 2.20 time: 0.190917 Aug 24 13:43:20.193232 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 300/607] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:43:20 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:43:20.331716 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-efab2289-065d-4574-ab78-8eda2fe56e84 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:20.332439 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-efab2289-065d-4574-ab78-8eda2fe56e84 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:20.334460 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=2 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:43:20.335112 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=10 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:43:20.340415 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-efab2289-065d-4574-ab78-8eda2fe56e84 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:20.340892 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-efab2289-065d-4574-ab78-8eda2fe56e84 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:20.341315 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-efab2289-065d-4574-ab78-8eda2fe56e84 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:20.342000 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-efab2289-065d-4574-ab78-8eda2fe56e84 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:20.342438 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-efab2289-065d-4574-ab78-8eda2fe56e84 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:20.342852 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-efab2289-065d-4574-ab78-8eda2fe56e84 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:20.519285 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-efab2289-065d-4574-ab78-8eda2fe56e84 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:20.529850 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-efab2289-065d-4574-ab78-8eda2fe56e84 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 200 len: 1265 microversion: 2.1 time: 0.203710 Aug 24 13:43:20.530449 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 308/608] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:20 2022] GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:43:21.215355 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-93482bce-a7bf-4c0f-a56b-d5faa51afde8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:21.216028 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-93482bce-a7bf-4c0f-a56b-d5faa51afde8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:21.217958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=12 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:43:21.222973 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-93482bce-a7bf-4c0f-a56b-d5faa51afde8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:21.223468 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-93482bce-a7bf-4c0f-a56b-d5faa51afde8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:21.223906 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-93482bce-a7bf-4c0f-a56b-d5faa51afde8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:21.224658 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-93482bce-a7bf-4c0f-a56b-d5faa51afde8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:21.225117 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-93482bce-a7bf-4c0f-a56b-d5faa51afde8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:21.225545 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-93482bce-a7bf-4c0f-a56b-d5faa51afde8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:21.362337 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-93482bce-a7bf-4c0f-a56b-d5faa51afde8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:21.371272 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-93482bce-a7bf-4c0f-a56b-d5faa51afde8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:21.372835 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-93482bce-a7bf-4c0f-a56b-d5faa51afde8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:21.373941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-93482bce-a7bf-4c0f-a56b-d5faa51afde8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1407 microversion: 2.20 time: 0.162791 Aug 24 13:43:21.374504 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 301/609] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:43:21 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:43:21.551381 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-1d62e08d-2c82-4b06-9808-215ee9a17df7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:21.551997 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-1d62e08d-2c82-4b06-9808-215ee9a17df7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:21.559495 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1d62e08d-2c82-4b06-9808-215ee9a17df7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:21.559916 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1d62e08d-2c82-4b06-9808-215ee9a17df7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:21.560380 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1d62e08d-2c82-4b06-9808-215ee9a17df7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:21.561077 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1d62e08d-2c82-4b06-9808-215ee9a17df7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:21.561532 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1d62e08d-2c82-4b06-9808-215ee9a17df7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:21.562215 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1d62e08d-2c82-4b06-9808-215ee9a17df7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:22.025291 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-1d62e08d-2c82-4b06-9808-215ee9a17df7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:22.034710 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-1d62e08d-2c82-4b06-9808-215ee9a17df7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 200 len: 1265 microversion: 2.1 time: 0.487083 Aug 24 13:43:22.035315 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 309/610] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:21 2022] GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 1265 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:43:22.104600 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-ba2978de-b7f3-4ebd-bb86-93cbc6e13a31 req-e2b6a1ed-d0d8-4549-ba35-bab0dfbda3c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d89846c9-96d3-4b1b-bba0-bc5d89c6bbde", "name": "network-vif-plugged", "status": "completed", "tag": "a8cb0618-6a5e-42d2-b95f-2fbf7a391e9a"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:43:22.114729 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-ba2978de-b7f3-4ebd-bb86-93cbc6e13a31 req-e2b6a1ed-d0d8-4549-ba35-bab0dfbda3c3 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:22.115434 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-ba2978de-b7f3-4ebd-bb86-93cbc6e13a31 req-e2b6a1ed-d0d8-4549-ba35-bab0dfbda3c3 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:22.115926 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-ba2978de-b7f3-4ebd-bb86-93cbc6e13a31 req-e2b6a1ed-d0d8-4549-ba35-bab0dfbda3c3 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:22.128203 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-ba2978de-b7f3-4ebd-bb86-93cbc6e13a31 req-e2b6a1ed-d0d8-4549-ba35-bab0dfbda3c3 service nova] Creating event network-vif-plugged:a8cb0618-6a5e-42d2-b95f-2fbf7a391e9a for instance d89846c9-96d3-4b1b-bba0-bc5d89c6bbde on hv-cinder-77957 Aug 24 13:43:22.134737 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-ba2978de-b7f3-4ebd-bb86-93cbc6e13a31 req-e2b6a1ed-d0d8-4549-ba35-bab0dfbda3c3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033602 Aug 24 13:43:22.135655 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 302/611] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:43:22.397201 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d533f86e-fbb3-44eb-98a5-da81574518f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:22.397732 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-d533f86e-fbb3-44eb-98a5-da81574518f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:22.404861 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d533f86e-fbb3-44eb-98a5-da81574518f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:22.405348 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d533f86e-fbb3-44eb-98a5-da81574518f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:22.405782 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d533f86e-fbb3-44eb-98a5-da81574518f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:22.406473 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d533f86e-fbb3-44eb-98a5-da81574518f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:22.406926 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d533f86e-fbb3-44eb-98a5-da81574518f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:22.407347 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d533f86e-fbb3-44eb-98a5-da81574518f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:22.542843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d533f86e-fbb3-44eb-98a5-da81574518f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:22.551195 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d533f86e-fbb3-44eb-98a5-da81574518f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:22.552701 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d533f86e-fbb3-44eb-98a5-da81574518f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:22.553840 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-d533f86e-fbb3-44eb-98a5-da81574518f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1600 microversion: 2.20 time: 0.160987 Aug 24 13:43:22.554451 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 310/612] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:43:22 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:43:22.577053 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-1b861e97-153d-441b-9ece-be22bbf5f56d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:22.577754 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-1b861e97-153d-441b-9ece-be22bbf5f56d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:22.584168 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1b861e97-153d-441b-9ece-be22bbf5f56d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:22.584769 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1b861e97-153d-441b-9ece-be22bbf5f56d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:22.585269 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1b861e97-153d-441b-9ece-be22bbf5f56d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:22.586029 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1b861e97-153d-441b-9ece-be22bbf5f56d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:22.586736 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1b861e97-153d-441b-9ece-be22bbf5f56d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:22.587963 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1b861e97-153d-441b-9ece-be22bbf5f56d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:22.716534 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-1b861e97-153d-441b-9ece-be22bbf5f56d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.143754 Aug 24 13:43:22.717272 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 303/613] 10.222.0.73 () {60 vars in 1316 bytes} [Wed Aug 24 13:43:22 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 13:43:23.055276 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-84fdf6b4-a2a7-48f2-9f68-99267fe7b8be tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:23.056281 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-84fdf6b4-a2a7-48f2-9f68-99267fe7b8be tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:23.065387 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-84fdf6b4-a2a7-48f2-9f68-99267fe7b8be tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:23.065974 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-84fdf6b4-a2a7-48f2-9f68-99267fe7b8be tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:23.066539 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-84fdf6b4-a2a7-48f2-9f68-99267fe7b8be tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:23.067278 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-84fdf6b4-a2a7-48f2-9f68-99267fe7b8be tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:23.067847 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-84fdf6b4-a2a7-48f2-9f68-99267fe7b8be tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:23.068305 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-84fdf6b4-a2a7-48f2-9f68-99267fe7b8be tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:23.462421 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-84fdf6b4-a2a7-48f2-9f68-99267fe7b8be tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:23.470716 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-84fdf6b4-a2a7-48f2-9f68-99267fe7b8be tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 200 len: 1265 microversion: 2.1 time: 0.419485 Aug 24 13:43:23.471303 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 311/614] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:23 2022] GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 1265 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:43:24.104537 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-214878cc-2c44-4b91-965b-19698ff0840c req-d230f79a-22c4-4413-8000-8372adb8b710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac19de18-372a-4cb9-bb59-0cb4b15e80b4", "tag": "a11fdd6d-daa9-44f9-b1cc-eeb70dbbd497"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:43:24.114551 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-214878cc-2c44-4b91-965b-19698ff0840c req-d230f79a-22c4-4413-8000-8372adb8b710 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:24.115068 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-214878cc-2c44-4b91-965b-19698ff0840c req-d230f79a-22c4-4413-8000-8372adb8b710 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:24.115499 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-214878cc-2c44-4b91-965b-19698ff0840c req-d230f79a-22c4-4413-8000-8372adb8b710 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:24.127905 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-214878cc-2c44-4b91-965b-19698ff0840c req-d230f79a-22c4-4413-8000-8372adb8b710 service nova] Creating event network-changed:a11fdd6d-daa9-44f9-b1cc-eeb70dbbd497 for instance ac19de18-372a-4cb9-bb59-0cb4b15e80b4 on hv-cinder-77957 Aug 24 13:43:24.133172 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-214878cc-2c44-4b91-965b-19698ff0840c req-d230f79a-22c4-4413-8000-8372adb8b710 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032928 Aug 24 13:43:24.134901 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 304/615] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:43:24.497227 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-3575123f-b132-493b-98bd-d8ae9984c46b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:24.497982 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-3575123f-b132-493b-98bd-d8ae9984c46b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:24.505513 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3575123f-b132-493b-98bd-d8ae9984c46b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:24.506004 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3575123f-b132-493b-98bd-d8ae9984c46b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:24.506439 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3575123f-b132-493b-98bd-d8ae9984c46b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:24.507143 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3575123f-b132-493b-98bd-d8ae9984c46b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:24.507592 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3575123f-b132-493b-98bd-d8ae9984c46b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:24.508042 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3575123f-b132-493b-98bd-d8ae9984c46b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:24.678451 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-3575123f-b132-493b-98bd-d8ae9984c46b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:24.680066 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-3575123f-b132-493b-98bd-d8ae9984c46b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 200 len: 1265 microversion: 2.1 time: 0.191544 Aug 24 13:43:24.684482 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 312/616] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:24 2022] GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:43:25.708985 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-21a9960f-781f-4006-a761-85c7c6bdcc11 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:25.708985 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-21a9960f-781f-4006-a761-85c7c6bdcc11 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:25.711219 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-21a9960f-781f-4006-a761-85c7c6bdcc11 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:25.711700 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-21a9960f-781f-4006-a761-85c7c6bdcc11 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:25.713309 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-21a9960f-781f-4006-a761-85c7c6bdcc11 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:25.714016 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-21a9960f-781f-4006-a761-85c7c6bdcc11 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:25.714481 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-21a9960f-781f-4006-a761-85c7c6bdcc11 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:25.714916 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-21a9960f-781f-4006-a761-85c7c6bdcc11 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:25.862249 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-21a9960f-781f-4006-a761-85c7c6bdcc11 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:25.870651 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-21a9960f-781f-4006-a761-85c7c6bdcc11 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 200 len: 1451 microversion: 2.1 time: 0.170581 Aug 24 13:43:25.871225 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 305/617] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:25 2022] GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 1451 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:43:25.899209 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-cd13e1d1-5f26-4695-9941-8e1506deef5b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:25.900433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-cd13e1d1-5f26-4695-9941-8e1506deef5b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:25.906965 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cd13e1d1-5f26-4695-9941-8e1506deef5b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:25.907446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cd13e1d1-5f26-4695-9941-8e1506deef5b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:25.907874 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cd13e1d1-5f26-4695-9941-8e1506deef5b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:25.908625 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cd13e1d1-5f26-4695-9941-8e1506deef5b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:25.909074 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cd13e1d1-5f26-4695-9941-8e1506deef5b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:25.909489 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cd13e1d1-5f26-4695-9941-8e1506deef5b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:26.048344 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-cd13e1d1-5f26-4695-9941-8e1506deef5b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:26.057140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-cd13e1d1-5f26-4695-9941-8e1506deef5b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 200 len: 1451 microversion: 2.1 time: 0.161559 Aug 24 13:43:26.057729 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 313/618] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:25 2022] GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:43:28.354590 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-71374295-98fd-40c5-8183-b33cda25af29 req-083c4d43-2ab1-4d18-8351-cad112fab3a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d89846c9-96d3-4b1b-bba0-bc5d89c6bbde", "tag": "a8cb0618-6a5e-42d2-b95f-2fbf7a391e9a"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:43:28.364618 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-71374295-98fd-40c5-8183-b33cda25af29 req-083c4d43-2ab1-4d18-8351-cad112fab3a2 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:28.372101 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-71374295-98fd-40c5-8183-b33cda25af29 req-083c4d43-2ab1-4d18-8351-cad112fab3a2 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:28.372101 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-71374295-98fd-40c5-8183-b33cda25af29 req-083c4d43-2ab1-4d18-8351-cad112fab3a2 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:28.383334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-71374295-98fd-40c5-8183-b33cda25af29 req-083c4d43-2ab1-4d18-8351-cad112fab3a2 service nova] Creating event network-changed:a8cb0618-6a5e-42d2-b95f-2fbf7a391e9a for instance d89846c9-96d3-4b1b-bba0-bc5d89c6bbde on hv-cinder-77957 Aug 24 13:43:28.383595 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-71374295-98fd-40c5-8183-b33cda25af29 req-083c4d43-2ab1-4d18-8351-cad112fab3a2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033423 Aug 24 13:43:28.384419 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 306/619] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:43:33.167218 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-6fe5fc03-9986-4cfc-b8b8-41490548d831 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:33.167783 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-6fe5fc03-9986-4cfc-b8b8-41490548d831 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:33.173792 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6fe5fc03-9986-4cfc-b8b8-41490548d831 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:33.178483 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6fe5fc03-9986-4cfc-b8b8-41490548d831 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:33.178483 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6fe5fc03-9986-4cfc-b8b8-41490548d831 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:33.178483 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6fe5fc03-9986-4cfc-b8b8-41490548d831 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:33.178483 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6fe5fc03-9986-4cfc-b8b8-41490548d831 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:33.178850 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6fe5fc03-9986-4cfc-b8b8-41490548d831 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:33.201852 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-6fe5fc03-9986-4cfc-b8b8-41490548d831 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/ips" status: 200 len: 150 microversion: 2.1 time: 0.150113 Aug 24 13:43:33.207193 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 314/620] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 13:43:33 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/ips => generated 150 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:43:34.864395 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-4ae280f1-a4dc-45f1-b359-82eed0104f29 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a40c7f2-b5cf-4787-8cab-dc1c76efdcb8"}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:43:34.866974 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-4ae280f1-a4dc-45f1-b359-82eed0104f29 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:34.873742 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4ae280f1-a4dc-45f1-b359-82eed0104f29 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:34.874234 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4ae280f1-a4dc-45f1-b359-82eed0104f29 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:34.874672 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4ae280f1-a4dc-45f1-b359-82eed0104f29 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:34.875405 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4ae280f1-a4dc-45f1-b359-82eed0104f29 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:34.875866 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4ae280f1-a4dc-45f1-b359-82eed0104f29 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:34.876329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4ae280f1-a4dc-45f1-b359-82eed0104f29 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:35.516149 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-ec18ab63-dd96-4d10-b1c4-d5b364041d2d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c713c28-f537-4b3b-bc2b-74752e9b9d7a"}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:43:35.518603 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-ec18ab63-dd96-4d10-b1c4-d5b364041d2d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:35.525339 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ec18ab63-dd96-4d10-b1c4-d5b364041d2d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:35.525861 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ec18ab63-dd96-4d10-b1c4-d5b364041d2d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:35.526289 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ec18ab63-dd96-4d10-b1c4-d5b364041d2d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:35.526973 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ec18ab63-dd96-4d10-b1c4-d5b364041d2d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:35.527414 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ec18ab63-dd96-4d10-b1c4-d5b364041d2d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:35.527836 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ec18ab63-dd96-4d10-b1c4-d5b364041d2d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:35.766934 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=100 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:43:35.767841 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-4ae280f1-a4dc-45f1-b359-82eed0104f29 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "POST /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.907954 Aug 24 13:43:35.770140 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 307/621] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 13:43:34 2022] POST /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/os-volume_attachments => generated 194 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:43:36.269571 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-ec18ab63-dd96-4d10-b1c4-d5b364041d2d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "POST /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.757053 Aug 24 13:43:36.270395 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 315/622] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 13:43:35 2022] POST /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments => generated 194 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:43:44.383260 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-39a589d9-acfa-465b-8efa-70de34fa5cc3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a40c7f2-b5cf-4787-8cab-dc1c76efdcb8"}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:43:44.386134 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-39a589d9-acfa-465b-8efa-70de34fa5cc3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:44.388491 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=52 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:43:44.394396 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-39a589d9-acfa-465b-8efa-70de34fa5cc3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:44.394919 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-39a589d9-acfa-465b-8efa-70de34fa5cc3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:44.395360 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-39a589d9-acfa-465b-8efa-70de34fa5cc3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:44.396064 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-39a589d9-acfa-465b-8efa-70de34fa5cc3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:44.396548 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-39a589d9-acfa-465b-8efa-70de34fa5cc3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:44.396980 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-39a589d9-acfa-465b-8efa-70de34fa5cc3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:44.401087 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:43:44.492756 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-39a589d9-acfa-465b-8efa-70de34fa5cc3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] HTTP exception thrown: Invalid volume: volume 6a40c7f2-b5cf-4787-8cab-dc1c76efdcb8 is already attached to instances: 5fb46333-4237-44a1-8a88-7d5171bfdb84 Aug 24 13:43:44.494782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-39a589d9-acfa-465b-8efa-70de34fa5cc3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Request method failure captured: Aug 24 13:43:44.494782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: POST /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/os-volume_attachments HTTP/1.1 Aug 24 13:43:44.494782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:43:44.494782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:43:44.494782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:43:44.494782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 74 Aug 24 13:43:44.494782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:43:44.494782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:43:44.494782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:43:44.494782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:43:44.494782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBinWm1p0b_H31lzxpPvzbV7rjy3F8Qzyn9V8PX7wwFXRHJCaJ71LLFkZ_Lkt8k4m1f9ymfMSrmW4KTZotPqVtGf-HmA9MGnpTEXSHWlAWKAH6WNjAbNhI-4NP4nK3tGleZkG8cnaBgxLFes9pTCCxx0p3rv03UC4QT5l95RSPxVokdw Aug 24 13:43:44.494782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:43:44.494782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:43:44.494782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:43:44.494782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:43:44.494782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:43:44.494782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:43:44.494782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:43:44.494782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:43:44.494782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:43:44.494782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:43:44.496395 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:43:44.496395 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:43:44.496395 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:43:44.496395 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:43:44.496395 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:43:44.496395 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:43:44.496395 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:43:44.496395 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: ea9d4eafe59c4c8180eece8ec9283e40 Aug 24 13:43:44.496395 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:43:44.496395 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Aug 24 13:43:44.496395 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {"volumeAttachment": {"volumeId": "6a40c7f2-b5cf-4787-8cab-dc1c76efdcb8"}} Aug 24 13:43:44.496395 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:43:44.504554 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Invalid volume: volume 6a40c7f2-b5cf-4787-8cab-dc1c76efdcb8 is already attached to instances: 5fb46333-4237-44a1-8a88-7d5171bfdb84 Aug 24 13:43:44.504554 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'server_id': '5fb46333-4237-44a1-8a88-7d5171bfdb84', 'body': {'volumeAttachment': {'volumeId': '6a40c7f2-b5cf-4787-8cab-dc1c76efdcb8'}}} Aug 24 13:43:44.504554 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:43:44.504554 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:43:44.504554 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 13:43:44.504554 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 13:43:44.504554 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 13:43:44.504554 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 13:43:44.504554 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 13:43:44.504554 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 13:43:44.504554 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 13:43:44.504554 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 13:43:44.504554 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 13:43:44.504554 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 13:43:44.504554 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6a40c7f2-b5cf-4787-8cab-dc1c76efdcb8 is already attached to instances: 5fb46333-4237-44a1-8a88-7d5171bfdb84 Aug 24 13:43:44.504554 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:43:44.504554 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:43:44.504554 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:43:44.504554 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:43:44.505941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:43:44.505941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:43:44.505941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:43:44.505941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:43:44.505941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:43:44.505941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:43:44.505941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 13:43:44.505941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 13:43:44.505941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 13:43:44.505941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 13:43:44.505941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 13:43:44.505941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 13:43:44.505941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 13:43:44.505941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 13:43:44.505941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6a40c7f2-b5cf-4787-8cab-dc1c76efdcb8 is already attached to instances: 5fb46333-4237-44a1-8a88-7d5171bfdb84 Aug 24 13:43:44.505941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:43:44.505941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:43:44.505941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:43:44.505941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:43:44.505941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:43:44.507240 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:43:44.507240 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:43:44.507240 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:43:44.507240 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6a40c7f2-b5cf-4787-8cab-dc1c76efdcb8 is already attached to instances: 5fb46333-4237-44a1-8a88-7d5171bfdb84 Aug 24 13:43:44.507240 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:43:44.507240 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-39a589d9-acfa-465b-8efa-70de34fa5cc3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Returning 400 to user: Invalid volume: volume 6a40c7f2-b5cf-4787-8cab-dc1c76efdcb8 is already attached to instances: 5fb46333-4237-44a1-8a88-7d5171bfdb84 {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:43:44.507240 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-39a589d9-acfa-465b-8efa-70de34fa5cc3 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "POST /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.117715 Aug 24 13:43:44.507240 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 308/623] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 13:43:44 2022] POST /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/os-volume_attachments => generated 174 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 13:43:44.568823 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-cba8ee41-5906-4291-817f-ea48b088dd5c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:44.569410 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-cba8ee41-5906-4291-817f-ea48b088dd5c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:44.571976 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_api:SELECT=32 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:43:44.577104 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cba8ee41-5906-4291-817f-ea48b088dd5c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:44.577590 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cba8ee41-5906-4291-817f-ea48b088dd5c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:44.578068 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cba8ee41-5906-4291-817f-ea48b088dd5c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:44.578774 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cba8ee41-5906-4291-817f-ea48b088dd5c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:44.579338 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cba8ee41-5906-4291-817f-ea48b088dd5c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:44.579774 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cba8ee41-5906-4291-817f-ea48b088dd5c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:44.664324 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.objects.instance [None req-cba8ee41-5906-4291-817f-ea48b088dd5c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lazy-loading 'services' on Instance uuid 5fb46333-4237-44a1-8a88-7d5171bfdb84 {{(pid=133015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:43:44.934174 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-cba8ee41-5906-4291-817f-ea48b088dd5c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/os-volume_attachments/6a40c7f2-b5cf-4787-8cab-dc1c76efdcb8" status: 202 len: 0 microversion: 2.1 time: 0.369302 Aug 24 13:43:44.934931 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 316/624] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 13:43:44 2022] DELETE /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/os-volume_attachments/6a40c7f2-b5cf-4787-8cab-dc1c76efdcb8 => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:43:44.945052 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-24d45ed2-7b10-4d11-9cd5-7a15684d3da1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:44.947416 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-24d45ed2-7b10-4d11-9cd5-7a15684d3da1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:44.956581 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-24d45ed2-7b10-4d11-9cd5-7a15684d3da1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:44.957088 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-24d45ed2-7b10-4d11-9cd5-7a15684d3da1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:44.957531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-24d45ed2-7b10-4d11-9cd5-7a15684d3da1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:44.958263 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-24d45ed2-7b10-4d11-9cd5-7a15684d3da1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:44.958743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-24d45ed2-7b10-4d11-9cd5-7a15684d3da1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:44.959178 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-24d45ed2-7b10-4d11-9cd5-7a15684d3da1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:44.991419 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-24d45ed2-7b10-4d11-9cd5-7a15684d3da1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050991 Aug 24 13:43:44.991994 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 309/625] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:43:44 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:43:46.008542 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-74e21489-e9dc-408c-9fab-cfa6d278ac96 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:46.011461 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-74e21489-e9dc-408c-9fab-cfa6d278ac96 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:46.019716 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-74e21489-e9dc-408c-9fab-cfa6d278ac96 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:46.020404 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-74e21489-e9dc-408c-9fab-cfa6d278ac96 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:46.020889 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-74e21489-e9dc-408c-9fab-cfa6d278ac96 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:46.021684 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-74e21489-e9dc-408c-9fab-cfa6d278ac96 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:46.022237 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-74e21489-e9dc-408c-9fab-cfa6d278ac96 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:46.022688 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-74e21489-e9dc-408c-9fab-cfa6d278ac96 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:46.061293 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-74e21489-e9dc-408c-9fab-cfa6d278ac96 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058944 Aug 24 13:43:46.062030 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 317/626] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:43:45 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:43:47.076584 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-17c97543-f7cf-474f-8269-b82f28a0aedf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:47.078927 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-17c97543-f7cf-474f-8269-b82f28a0aedf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:47.086539 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-17c97543-f7cf-474f-8269-b82f28a0aedf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:47.087039 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-17c97543-f7cf-474f-8269-b82f28a0aedf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:47.087475 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-17c97543-f7cf-474f-8269-b82f28a0aedf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:47.088226 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-17c97543-f7cf-474f-8269-b82f28a0aedf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:47.088671 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-17c97543-f7cf-474f-8269-b82f28a0aedf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:47.089096 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-17c97543-f7cf-474f-8269-b82f28a0aedf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:47.124498 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-17c97543-f7cf-474f-8269-b82f28a0aedf tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052412 Aug 24 13:43:47.125660 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 310/627] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:43:47 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:43:48.138085 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-087434b6-9fd8-429b-9751-936be568da54 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:48.141174 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-087434b6-9fd8-429b-9751-936be568da54 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:48.148699 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-087434b6-9fd8-429b-9751-936be568da54 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:48.149198 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-087434b6-9fd8-429b-9751-936be568da54 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:48.149640 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-087434b6-9fd8-429b-9751-936be568da54 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:48.150353 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-087434b6-9fd8-429b-9751-936be568da54 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:48.150812 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-087434b6-9fd8-429b-9751-936be568da54 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:48.151244 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-087434b6-9fd8-429b-9751-936be568da54 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:48.186018 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-087434b6-9fd8-429b-9751-936be568da54 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052012 Aug 24 13:43:48.186621 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 318/628] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:43:48 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:43:49.199155 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-91f321c1-e5fa-41c4-a3f4-d9b4a507f0a5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:49.201412 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-91f321c1-e5fa-41c4-a3f4-d9b4a507f0a5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:49.208928 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-91f321c1-e5fa-41c4-a3f4-d9b4a507f0a5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:49.209431 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-91f321c1-e5fa-41c4-a3f4-d9b4a507f0a5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:49.209874 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-91f321c1-e5fa-41c4-a3f4-d9b4a507f0a5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:49.210666 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-91f321c1-e5fa-41c4-a3f4-d9b4a507f0a5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:49.211210 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-91f321c1-e5fa-41c4-a3f4-d9b4a507f0a5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:49.212207 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-91f321c1-e5fa-41c4-a3f4-d9b4a507f0a5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:49.246136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-91f321c1-e5fa-41c4-a3f4-d9b4a507f0a5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050987 Aug 24 13:43:49.246731 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 311/629] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:43:49 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:43:50.263428 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-807d5370-9da5-4e98-9d0e-43cb0cb9ef9a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:50.265807 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-807d5370-9da5-4e98-9d0e-43cb0cb9ef9a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:50.274026 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-807d5370-9da5-4e98-9d0e-43cb0cb9ef9a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:50.274534 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-807d5370-9da5-4e98-9d0e-43cb0cb9ef9a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:50.275000 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-807d5370-9da5-4e98-9d0e-43cb0cb9ef9a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:50.275715 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-807d5370-9da5-4e98-9d0e-43cb0cb9ef9a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:50.276165 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-807d5370-9da5-4e98-9d0e-43cb0cb9ef9a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:50.276637 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-807d5370-9da5-4e98-9d0e-43cb0cb9ef9a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:50.319350 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-807d5370-9da5-4e98-9d0e-43cb0cb9ef9a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062549 Aug 24 13:43:50.320004 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 319/630] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:43:50 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:43:51.337678 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-eb7a10cb-8282-4514-b448-9ac4e75e3309 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:51.340987 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-eb7a10cb-8282-4514-b448-9ac4e75e3309 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:51.349950 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-373ad455-206b-47c2-8f74-c48c4fe51a1a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:43:51.350605 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eb7a10cb-8282-4514-b448-9ac4e75e3309 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:51.350837 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eb7a10cb-8282-4514-b448-9ac4e75e3309 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:51.351300 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eb7a10cb-8282-4514-b448-9ac4e75e3309 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:51.352046 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eb7a10cb-8282-4514-b448-9ac4e75e3309 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:51.352776 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eb7a10cb-8282-4514-b448-9ac4e75e3309 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:51.352904 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-373ad455-206b-47c2-8f74-c48c4fe51a1a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:51.353217 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eb7a10cb-8282-4514-b448-9ac4e75e3309 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:51.361349 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-373ad455-206b-47c2-8f74-c48c4fe51a1a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:51.361838 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-373ad455-206b-47c2-8f74-c48c4fe51a1a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:51.362274 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-373ad455-206b-47c2-8f74-c48c4fe51a1a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:51.362977 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-373ad455-206b-47c2-8f74-c48c4fe51a1a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:51.363422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-373ad455-206b-47c2-8f74-c48c4fe51a1a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:51.363836 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-373ad455-206b-47c2-8f74-c48c4fe51a1a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:51.389111 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.objects.instance [None req-373ad455-206b-47c2-8f74-c48c4fe51a1a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lazy-loading 'flavor' on Instance uuid c1b259b6-2024-4b30-865d-17dadaef5406 {{(pid=133015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:43:51.398609 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-eb7a10cb-8282-4514-b448-9ac4e75e3309 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066888 Aug 24 13:43:51.399535 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 312/631] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:43:51 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:43:51.865145 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-373ad455-206b-47c2-8f74-c48c4fe51a1a tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "POST /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/action" status: 200 len: 32 microversion: 2.1 time: 0.519252 Aug 24 13:43:51.867169 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 320/632] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 13:43:51 2022] POST /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/action => generated 32 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 13:43:51.881888 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-4c67e9c3-c1d7-4433-9a71-2170d2c56bd9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:51.883222 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-4c67e9c3-c1d7-4433-9a71-2170d2c56bd9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:51.897143 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4c67e9c3-c1d7-4433-9a71-2170d2c56bd9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:51.897717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4c67e9c3-c1d7-4433-9a71-2170d2c56bd9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:51.898230 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4c67e9c3-c1d7-4433-9a71-2170d2c56bd9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:51.899040 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4c67e9c3-c1d7-4433-9a71-2170d2c56bd9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:51.899767 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4c67e9c3-c1d7-4433-9a71-2170d2c56bd9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:51.900294 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4c67e9c3-c1d7-4433-9a71-2170d2c56bd9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:52.108702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-4c67e9c3-c1d7-4433-9a71-2170d2c56bd9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:52.118865 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-4c67e9c3-c1d7-4433-9a71-2170d2c56bd9 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1734 microversion: 2.1 time: 0.242941 Aug 24 13:43:52.119474 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 313/633] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:51 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1734 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:43:52.418571 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a2e7e7d8-39db-483c-8140-2c9b246901f5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:52.424077 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-a2e7e7d8-39db-483c-8140-2c9b246901f5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:52.431538 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a2e7e7d8-39db-483c-8140-2c9b246901f5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:52.432214 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a2e7e7d8-39db-483c-8140-2c9b246901f5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:52.432748 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a2e7e7d8-39db-483c-8140-2c9b246901f5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:52.433715 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a2e7e7d8-39db-483c-8140-2c9b246901f5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:52.434372 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a2e7e7d8-39db-483c-8140-2c9b246901f5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:52.434937 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a2e7e7d8-39db-483c-8140-2c9b246901f5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:52.500945 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a2e7e7d8-39db-483c-8140-2c9b246901f5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090603 Aug 24 13:43:52.501947 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 321/634] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:43:52 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 13:43:52.616762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-46a8d6d2-36ce-4512-b06b-8fbfae27ec0c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:52.618667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-46a8d6d2-36ce-4512-b06b-8fbfae27ec0c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:52.630899 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-46a8d6d2-36ce-4512-b06b-8fbfae27ec0c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:52.631784 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-46a8d6d2-36ce-4512-b06b-8fbfae27ec0c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:52.632667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-46a8d6d2-36ce-4512-b06b-8fbfae27ec0c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:52.634018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-46a8d6d2-36ce-4512-b06b-8fbfae27ec0c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:52.634857 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-46a8d6d2-36ce-4512-b06b-8fbfae27ec0c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:52.635642 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-46a8d6d2-36ce-4512-b06b-8fbfae27ec0c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:52.685319 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-46a8d6d2-36ce-4512-b06b-8fbfae27ec0c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Going to try to terminate instance {{(pid=133014) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 13:43:53.031279 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-46a8d6d2-36ce-4512-b06b-8fbfae27ec0c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84" status: 204 len: 0 microversion: 2.1 time: 0.421019 Aug 24 13:43:53.032608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 314/635] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:43:52 2022] DELETE /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:43:53.042196 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-89166185-2850-4b06-91d3-e28e8f4d60de tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:53.043058 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-89166185-2850-4b06-91d3-e28e8f4d60de tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:53.051838 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-89166185-2850-4b06-91d3-e28e8f4d60de tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:53.052542 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-89166185-2850-4b06-91d3-e28e8f4d60de tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:53.053055 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-89166185-2850-4b06-91d3-e28e8f4d60de tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:53.054034 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-89166185-2850-4b06-91d3-e28e8f4d60de tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:53.054610 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-89166185-2850-4b06-91d3-e28e8f4d60de tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:53.055127 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-89166185-2850-4b06-91d3-e28e8f4d60de tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:53.145030 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-288a7873-db60-4370-9ade-5e61029939d6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:53.146043 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-288a7873-db60-4370-9ade-5e61029939d6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:53.154540 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-288a7873-db60-4370-9ade-5e61029939d6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:53.155309 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-288a7873-db60-4370-9ade-5e61029939d6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:53.156584 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-288a7873-db60-4370-9ade-5e61029939d6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:53.157598 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-288a7873-db60-4370-9ade-5e61029939d6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:53.158233 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-288a7873-db60-4370-9ade-5e61029939d6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:53.159640 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-288a7873-db60-4370-9ade-5e61029939d6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:53.308867 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-89166185-2850-4b06-91d3-e28e8f4d60de tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:53.320533 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-89166185-2850-4b06-91d3-e28e8f4d60de tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84" status: 200 len: 1682 microversion: 2.1 time: 0.282695 Aug 24 13:43:53.321136 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 322/636] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:53 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84 => generated 1682 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:43:53.388586 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-288a7873-db60-4370-9ade-5e61029939d6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:53.398380 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-288a7873-db60-4370-9ade-5e61029939d6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1734 microversion: 2.1 time: 0.259979 Aug 24 13:43:53.398965 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 315/637] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:53 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1734 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:43:54.343775 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b7354b4e-4418-4dfc-bf90-63f35c028e2f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:54.344528 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b7354b4e-4418-4dfc-bf90-63f35c028e2f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:54.354262 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b7354b4e-4418-4dfc-bf90-63f35c028e2f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:54.355002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b7354b4e-4418-4dfc-bf90-63f35c028e2f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:54.355705 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b7354b4e-4418-4dfc-bf90-63f35c028e2f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:54.356678 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b7354b4e-4418-4dfc-bf90-63f35c028e2f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:54.357201 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b7354b4e-4418-4dfc-bf90-63f35c028e2f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:54.357629 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b7354b4e-4418-4dfc-bf90-63f35c028e2f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:54.439916 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-329d4a29-d751-414b-8c8f-41ce9c2a769e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:54.440954 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-329d4a29-d751-414b-8c8f-41ce9c2a769e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:54.449534 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-329d4a29-d751-414b-8c8f-41ce9c2a769e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:54.450032 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-329d4a29-d751-414b-8c8f-41ce9c2a769e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:54.450715 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-329d4a29-d751-414b-8c8f-41ce9c2a769e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:54.451453 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-329d4a29-d751-414b-8c8f-41ce9c2a769e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:54.452078 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-329d4a29-d751-414b-8c8f-41ce9c2a769e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:54.452642 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-329d4a29-d751-414b-8c8f-41ce9c2a769e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:54.611628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b7354b4e-4418-4dfc-bf90-63f35c028e2f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:54.619960 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b7354b4e-4418-4dfc-bf90-63f35c028e2f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84" status: 200 len: 1682 microversion: 2.1 time: 0.280762 Aug 24 13:43:54.624226 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 323/638] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:54 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84 => generated 1682 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:43:54.660634 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-329d4a29-d751-414b-8c8f-41ce9c2a769e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:54.677175 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-329d4a29-d751-414b-8c8f-41ce9c2a769e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1734 microversion: 2.1 time: 0.242919 Aug 24 13:43:54.678189 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 316/639] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:54 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1734 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:43:55.644584 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-ae7b51c7-ef82-48a9-b544-1cff90dcc34a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:55.645446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-ae7b51c7-ef82-48a9-b544-1cff90dcc34a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:55.652347 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ae7b51c7-ef82-48a9-b544-1cff90dcc34a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:55.657987 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ae7b51c7-ef82-48a9-b544-1cff90dcc34a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:55.657987 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ae7b51c7-ef82-48a9-b544-1cff90dcc34a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:55.657987 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ae7b51c7-ef82-48a9-b544-1cff90dcc34a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:55.657987 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ae7b51c7-ef82-48a9-b544-1cff90dcc34a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:55.658590 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ae7b51c7-ef82-48a9-b544-1cff90dcc34a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:55.706739 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e50894f3-da37-42f8-8e31-6fcf522b84e2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:55.707762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-e50894f3-da37-42f8-8e31-6fcf522b84e2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:55.714785 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e50894f3-da37-42f8-8e31-6fcf522b84e2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:55.715380 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e50894f3-da37-42f8-8e31-6fcf522b84e2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:55.715894 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e50894f3-da37-42f8-8e31-6fcf522b84e2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:55.716712 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e50894f3-da37-42f8-8e31-6fcf522b84e2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:55.717205 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e50894f3-da37-42f8-8e31-6fcf522b84e2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:55.717636 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e50894f3-da37-42f8-8e31-6fcf522b84e2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:55.992621 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-ae7b51c7-ef82-48a9-b544-1cff90dcc34a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:56.001580 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-ae7b51c7-ef82-48a9-b544-1cff90dcc34a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84" status: 200 len: 1682 microversion: 2.1 time: 0.362137 Aug 24 13:43:56.002306 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 324/640] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:55 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84 => generated 1682 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:43:56.014376 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e50894f3-da37-42f8-8e31-6fcf522b84e2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:56.026590 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-e50894f3-da37-42f8-8e31-6fcf522b84e2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1734 microversion: 2.1 time: 0.325030 Aug 24 13:43:56.027193 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 317/641] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:55 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1734 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:43:56.755012 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-bc65e8d6-68cc-40f9-b952-c2d93f8b0e77 req-2b307a5f-6729-4a83-94af-7ca95fa88574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb46333-4237-44a1-8a88-7d5171bfdb84", "name": "network-vif-deleted", "tag": "4e40061a-00da-4a8b-ae82-5150e0416828"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:43:56.770436 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-bc65e8d6-68cc-40f9-b952-c2d93f8b0e77 req-2b307a5f-6729-4a83-94af-7ca95fa88574 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:56.770862 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-bc65e8d6-68cc-40f9-b952-c2d93f8b0e77 req-2b307a5f-6729-4a83-94af-7ca95fa88574 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:56.772593 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-bc65e8d6-68cc-40f9-b952-c2d93f8b0e77 req-2b307a5f-6729-4a83-94af-7ca95fa88574 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:56.794878 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-bc65e8d6-68cc-40f9-b952-c2d93f8b0e77 req-2b307a5f-6729-4a83-94af-7ca95fa88574 service nova] Creating event network-vif-deleted:4e40061a-00da-4a8b-ae82-5150e0416828 for instance 5fb46333-4237-44a1-8a88-7d5171bfdb84 on hv-cinder-77957 Aug 24 13:43:56.804798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-bc65e8d6-68cc-40f9-b952-c2d93f8b0e77 req-2b307a5f-6729-4a83-94af-7ca95fa88574 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160946 Aug 24 13:43:56.810935 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 325/642] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:43:57.030319 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-13957544-100f-4e1f-a1ef-ea083f6bd23a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:57.032064 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-13957544-100f-4e1f-a1ef-ea083f6bd23a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:57.046868 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-13957544-100f-4e1f-a1ef-ea083f6bd23a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:57.047931 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-13957544-100f-4e1f-a1ef-ea083f6bd23a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:57.049357 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-13957544-100f-4e1f-a1ef-ea083f6bd23a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:57.050614 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-13957544-100f-4e1f-a1ef-ea083f6bd23a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:57.051392 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-13957544-100f-4e1f-a1ef-ea083f6bd23a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:57.052856 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a592ba2c-f705-4fe2-b893-b5b02a74afc6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:57.053026 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-13957544-100f-4e1f-a1ef-ea083f6bd23a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:57.054001 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-a592ba2c-f705-4fe2-b893-b5b02a74afc6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:57.061517 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a592ba2c-f705-4fe2-b893-b5b02a74afc6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:57.062935 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a592ba2c-f705-4fe2-b893-b5b02a74afc6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:57.063914 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a592ba2c-f705-4fe2-b893-b5b02a74afc6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:57.064992 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a592ba2c-f705-4fe2-b893-b5b02a74afc6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:57.065879 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a592ba2c-f705-4fe2-b893-b5b02a74afc6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:57.066550 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a592ba2c-f705-4fe2-b893-b5b02a74afc6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:57.111661 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-13957544-100f-4e1f-a1ef-ea083f6bd23a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:57.114934 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-13957544-100f-4e1f-a1ef-ea083f6bd23a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:57.115618 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-13957544-100f-4e1f-a1ef-ea083f6bd23a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:57.116353 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.objects.instance [None req-13957544-100f-4e1f-a1ef-ea083f6bd23a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lazy-loading 'fault' on Instance uuid 5fb46333-4237-44a1-8a88-7d5171bfdb84 {{(pid=133014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:43:57.212220 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-13957544-100f-4e1f-a1ef-ea083f6bd23a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:57.240125 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-13957544-100f-4e1f-a1ef-ea083f6bd23a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84" status: 200 len: 1331 microversion: 2.1 time: 0.216711 Aug 24 13:43:57.241103 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 318/643] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:57 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84 => generated 1331 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:43:57.286104 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-a592ba2c-f705-4fe2-b893-b5b02a74afc6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:57.299818 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a592ba2c-f705-4fe2-b893-b5b02a74afc6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1734 microversion: 2.1 time: 0.252864 Aug 24 13:43:57.307121 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 326/644] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:57 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1734 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:43:58.284536 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-b8ee3d82-e715-43e5-b954-5f2ece99e468 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:58.285589 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-b8ee3d82-e715-43e5-b954-5f2ece99e468 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:58.293771 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b8ee3d82-e715-43e5-b954-5f2ece99e468 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:58.294399 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b8ee3d82-e715-43e5-b954-5f2ece99e468 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:58.294981 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b8ee3d82-e715-43e5-b954-5f2ece99e468 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:58.295764 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b8ee3d82-e715-43e5-b954-5f2ece99e468 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:58.296367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b8ee3d82-e715-43e5-b954-5f2ece99e468 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:58.297724 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b8ee3d82-e715-43e5-b954-5f2ece99e468 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:58.318247 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-b8ee3d82-e715-43e5-b954-5f2ece99e468 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] HTTP exception thrown: Instance 5fb46333-4237-44a1-8a88-7d5171bfdb84 could not be found. Aug 24 13:43:58.321364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-b8ee3d82-e715-43e5-b954-5f2ece99e468 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Request method failure captured: Aug 24 13:43:58.321364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84 HTTP/1.1 Aug 24 13:43:58.321364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:43:58.321364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:43:58.321364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:43:58.321364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:43:58.321364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:43:58.321364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:43:58.321364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:43:58.321364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:43:58.321364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBinWm1p0b_H31lzxpPvzbV7rjy3F8Qzyn9V8PX7wwFXRHJCaJ71LLFkZ_Lkt8k4m1f9ymfMSrmW4KTZotPqVtGf-HmA9MGnpTEXSHWlAWKAH6WNjAbNhI-4NP4nK3tGleZkG8cnaBgxLFes9pTCCxx0p3rv03UC4QT5l95RSPxVokdw Aug 24 13:43:58.321364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:43:58.321364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:43:58.321364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:43:58.321364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:43:58.321364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:43:58.321364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:43:58.321364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:43:58.321364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:43:58.321364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:43:58.321364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:43:58.322775 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:43:58.322775 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:43:58.322775 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:43:58.322775 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:43:58.322775 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:43:58.322775 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:43:58.322775 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:43:58.322775 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: ea9d4eafe59c4c8180eece8ec9283e40 Aug 24 13:43:58.322775 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:43:58.322775 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:43:58.322775 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Instance 5fb46333-4237-44a1-8a88-7d5171bfdb84 could not be found. Aug 24 13:43:58.322775 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': '5fb46333-4237-44a1-8a88-7d5171bfdb84'} Aug 24 13:43:58.323644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:43:58.323644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:43:58.323644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:43:58.323644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:43:58.323644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:43:58.323644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:43:58.323644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:43:58.323644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:43:58.323644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:43:58.323644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:43:58.323644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb46333-4237-44a1-8a88-7d5171bfdb84 could not be found. Aug 24 13:43:58.323644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:43:58.323644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:43:58.323644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:43:58.323644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:43:58.323644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:43:58.323644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:43:58.323644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:43:58.323644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:43:58.323644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:43:58.324961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:43:58.324961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:43:58.324961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:43:58.324961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:43:58.324961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:43:58.324961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:43:58.324961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:43:58.324961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb46333-4237-44a1-8a88-7d5171bfdb84 could not be found. Aug 24 13:43:58.324961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:43:58.324961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:43:58.324961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:43:58.324961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:43:58.324961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:43:58.324961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:43:58.324961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:43:58.324961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:43:58.324961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb46333-4237-44a1-8a88-7d5171bfdb84 could not be found. Aug 24 13:43:58.324961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:43:58.326056 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-b8ee3d82-e715-43e5-b954-5f2ece99e468 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Returning 404 to user: Instance 5fb46333-4237-44a1-8a88-7d5171bfdb84 could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:43:58.326056 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-b8ee3d82-e715-43e5-b954-5f2ece99e468 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84" status: 404 len: 111 microversion: 2.1 time: 0.044095 Aug 24 13:43:58.326056 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 319/645] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:58 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:43:58.328388 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-264ba9a1-78f9-4d43-975a-3578f05e4ad5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:58.329577 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-264ba9a1-78f9-4d43-975a-3578f05e4ad5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:58.340705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-01e3a949-84bb-4ec1-968f-b1bfbd2f075a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '.version_select at 0x7f96c230cca0>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:58.345874 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-264ba9a1-78f9-4d43-975a-3578f05e4ad5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:58.345874 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-264ba9a1-78f9-4d43-975a-3578f05e4ad5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:58.345874 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-264ba9a1-78f9-4d43-975a-3578f05e4ad5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:58.345874 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-264ba9a1-78f9-4d43-975a-3578f05e4ad5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:58.346537 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-264ba9a1-78f9-4d43-975a-3578f05e4ad5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:58.347656 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-264ba9a1-78f9-4d43-975a-3578f05e4ad5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:58.434672 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-01e3a949-84bb-4ec1-968f-b1bfbd2f075a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-324044717" status: 202 len: 0 microversion: 2.1 time: 0.100307 Aug 24 13:43:58.436063 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 320/646] 10.222.0.73 () {58 vars in 1218 bytes} [Wed Aug 24 13:43:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-324044717 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:43:58.570780 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-264ba9a1-78f9-4d43-975a-3578f05e4ad5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:58.580692 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-264ba9a1-78f9-4d43-975a-3578f05e4ad5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1734 microversion: 2.1 time: 0.261611 Aug 24 13:43:58.581307 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 327/647] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:58 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1734 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:43:59.607653 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-50421176-d30d-4a4a-b121-6058d31c74fe tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:43:59.609143 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-50421176-d30d-4a4a-b121-6058d31c74fe tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:43:59.617929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-50421176-d30d-4a4a-b121-6058d31c74fe tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:59.618429 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-50421176-d30d-4a4a-b121-6058d31c74fe tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:59.618894 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-50421176-d30d-4a4a-b121-6058d31c74fe tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:59.619787 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-50421176-d30d-4a4a-b121-6058d31c74fe tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:43:59.620251 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-50421176-d30d-4a4a-b121-6058d31c74fe tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:43:59.620684 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-50421176-d30d-4a4a-b121-6058d31c74fe tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:43:59.646381 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-44e4da8e-47aa-4168-bc36-9a68044ce1ba tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Action: 'create', calling method: .version_select at 0x7f96c20d3790>, body: {"keypair": {"name": "tempest-keypair-2085277291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGF8CZqs1eFA3nHvE60CFeBhRpH1tpBQ7HEW3b+mdIMTg63zWDLLIfdm0ppazr+RngWXuQPLC4FdPvw81dbHFCRGfawbjnuG1OdDWn30NU3qAx+geU+S1ZbT/z9yoZ9Ew=="}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:43:59.665602 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-44e4da8e-47aa-4168-bc36-9a68044ce1ba tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Getting quotas for project 019b2e8bdb934d94a25fe4b355e73c68. Resources: {'key_pairs'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:43:59.670417 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-44e4da8e-47aa-4168-bc36-9a68044ce1ba tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Getting quotas for user ea9d4eafe59c4c8180eece8ec9283e40 and project 019b2e8bdb934d94a25fe4b355e73c68. Resources: {'key_pairs'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:43:59.760863 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-44e4da8e-47aa-4168-bc36-9a68044ce1ba tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.118112 Aug 24 13:43:59.762517 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 328/648] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 13:43:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:43:59.799369 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-50421176-d30d-4a4a-b121-6058d31c74fe tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:43:59.810730 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-50421176-d30d-4a4a-b121-6058d31c74fe tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1734 microversion: 2.1 time: 0.208851 Aug 24 13:43:59.811332 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 321/649] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:43:59 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1734 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:44:00.837388 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-eb28e2fa-00c3-4651-b228-42eae6000da1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:00.838162 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-eb28e2fa-00c3-4651-b228-42eae6000da1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:00.848009 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-eb28e2fa-00c3-4651-b228-42eae6000da1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:00.860396 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-eb28e2fa-00c3-4651-b228-42eae6000da1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:00.860396 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-eb28e2fa-00c3-4651-b228-42eae6000da1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:00.860396 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-eb28e2fa-00c3-4651-b228-42eae6000da1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:00.860396 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-eb28e2fa-00c3-4651-b228-42eae6000da1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:00.861372 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-eb28e2fa-00c3-4651-b228-42eae6000da1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:01.019092 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-eb28e2fa-00c3-4651-b228-42eae6000da1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:01.028004 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-eb28e2fa-00c3-4651-b228-42eae6000da1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1734 microversion: 2.1 time: 0.197179 Aug 24 13:44:01.032847 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 329/650] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:00 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1734 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:44:02.050892 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-8b36e3d8-b7ae-4f66-81dc-38e775b08256 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:02.051635 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-8b36e3d8-b7ae-4f66-81dc-38e775b08256 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:02.058237 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8b36e3d8-b7ae-4f66-81dc-38e775b08256 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:02.058738 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8b36e3d8-b7ae-4f66-81dc-38e775b08256 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:02.059190 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8b36e3d8-b7ae-4f66-81dc-38e775b08256 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:02.059906 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8b36e3d8-b7ae-4f66-81dc-38e775b08256 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:02.060401 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8b36e3d8-b7ae-4f66-81dc-38e775b08256 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:02.060842 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8b36e3d8-b7ae-4f66-81dc-38e775b08256 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:02.233463 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-8b36e3d8-b7ae-4f66-81dc-38e775b08256 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:02.247310 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-8b36e3d8-b7ae-4f66-81dc-38e775b08256 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1734 microversion: 2.1 time: 0.200845 Aug 24 13:44:02.248080 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 322/651] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:02 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1734 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:44:02.348390 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-ac067945-bbd3-4da8-8042-f7b5d608e43d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-575080370", "imageRef": "c520113c-3dae-4490-98bb-19fe3a46b66d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "789a27f6-7f62-4022-86ef-1042c82fc322"}], "security_groups": [{"name": "tempest-securitygroup--1270076912"}], "key_name": "tempest-keypair-2085277291", "user_data": "}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:44:02.498412 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.network.neutron [None req-ac067945-bbd3-4da8-8042-f7b5d608e43d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] validate_networks() for [('789a27f6-7f62-4022-86ef-1042c82fc322', None, None, None, None, None)] {{(pid=133015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:44:03.101291 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-ac067945-bbd3-4da8-8042-f7b5d608e43d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Flavor limits 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:44:03.101914 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-ac067945-bbd3-4da8-8042-f7b5d608e43d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Image limits 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:44:03.102659 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-ac067945-bbd3-4da8-8042-f7b5d608e43d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Flavor pref 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:44:03.103258 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-ac067945-bbd3-4da8-8042-f7b5d608e43d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Image pref 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:44:03.103857 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-ac067945-bbd3-4da8-8042-f7b5d608e43d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:44:03.118897 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ac067945-bbd3-4da8-8042-f7b5d608e43d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:03.119640 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ac067945-bbd3-4da8-8042-f7b5d608e43d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:03.120318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ac067945-bbd3-4da8-8042-f7b5d608e43d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:03.121446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ac067945-bbd3-4da8-8042-f7b5d608e43d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:03.122308 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ac067945-bbd3-4da8-8042-f7b5d608e43d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:03.123069 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ac067945-bbd3-4da8-8042-f7b5d608e43d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:03.148220 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-ac067945-bbd3-4da8-8042-f7b5d608e43d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Getting quotas for project 019b2e8bdb934d94a25fe4b355e73c68. Resources: {'instances', 'cores', 'ram'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:44:03.152655 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-ac067945-bbd3-4da8-8042-f7b5d608e43d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Getting quotas for user ea9d4eafe59c4c8180eece8ec9283e40 and project 019b2e8bdb934d94a25fe4b355e73c68. Resources: {'instances', 'cores', 'ram'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:44:03.165638 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-ac067945-bbd3-4da8-8042-f7b5d608e43d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Going to run 1 instances... {{(pid=133015) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 13:44:03.168052 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-ac067945-bbd3-4da8-8042-f7b5d608e43d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c520113c-3dae-4490-98bb-19fe3a46b66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 13:44:03.269175 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-40e82504-a2d6-4935-a941-8eebd0842a99 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:03.269800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-40e82504-a2d6-4935-a941-8eebd0842a99 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:03.277133 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-40e82504-a2d6-4935-a941-8eebd0842a99 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:03.277624 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-40e82504-a2d6-4935-a941-8eebd0842a99 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:03.278106 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-40e82504-a2d6-4935-a941-8eebd0842a99 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:03.278815 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-40e82504-a2d6-4935-a941-8eebd0842a99 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:03.279281 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-40e82504-a2d6-4935-a941-8eebd0842a99 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:03.279715 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-40e82504-a2d6-4935-a941-8eebd0842a99 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:03.443384 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-40e82504-a2d6-4935-a941-8eebd0842a99 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:03.452061 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-40e82504-a2d6-4935-a941-8eebd0842a99 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1734 microversion: 2.1 time: 0.186762 Aug 24 13:44:03.453794 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 323/652] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:03 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1734 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:44:03.504380 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-ac067945-bbd3-4da8-8042-f7b5d608e43d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.161368 Aug 24 13:44:03.505295 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 330/653] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 13:44:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 13:44:03.521744 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-4166db59-e022-4e60-acd3-5842e4952d65 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:03.522571 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-4166db59-e022-4e60-acd3-5842e4952d65 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:03.596696 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-4166db59-e022-4e60-acd3-5842e4952d65 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:03.604808 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-4166db59-e022-4e60-acd3-5842e4952d65 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25" status: 200 len: 1241 microversion: 2.1 time: 0.089662 Aug 24 13:44:03.606001 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 324/654] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:03 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:44:04.480484 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-0726a58a-fd6e-4f92-b261-40845425f074 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:04.481571 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-0726a58a-fd6e-4f92-b261-40845425f074 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:04.495607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0726a58a-fd6e-4f92-b261-40845425f074 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:04.496248 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0726a58a-fd6e-4f92-b261-40845425f074 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:04.496708 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0726a58a-fd6e-4f92-b261-40845425f074 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:04.497458 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0726a58a-fd6e-4f92-b261-40845425f074 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:04.497935 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0726a58a-fd6e-4f92-b261-40845425f074 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:04.498390 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0726a58a-fd6e-4f92-b261-40845425f074 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:04.504840 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:44:04.636711 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e2007c6b-46a3-4cfa-95bb-e15dca12483a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:04.637489 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-e2007c6b-46a3-4cfa-95bb-e15dca12483a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:04.644456 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-0726a58a-fd6e-4f92-b261-40845425f074 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:04.653044 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-0726a58a-fd6e-4f92-b261-40845425f074 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1734 microversion: 2.1 time: 0.180674 Aug 24 13:44:04.653622 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 331/655] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:04 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:44:04.697368 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e2007c6b-46a3-4cfa-95bb-e15dca12483a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:04.707553 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-e2007c6b-46a3-4cfa-95bb-e15dca12483a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25" status: 200 len: 1241 microversion: 2.1 time: 0.074654 Aug 24 13:44:04.710943 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 325/656] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:04 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:44:05.678246 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-65736e54-8c6d-4977-9304-4b1b39baecfb tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:05.679282 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-65736e54-8c6d-4977-9304-4b1b39baecfb tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:05.690085 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-65736e54-8c6d-4977-9304-4b1b39baecfb tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:05.690581 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-65736e54-8c6d-4977-9304-4b1b39baecfb tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:05.691021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-65736e54-8c6d-4977-9304-4b1b39baecfb tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:05.691737 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-65736e54-8c6d-4977-9304-4b1b39baecfb tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:05.692214 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-65736e54-8c6d-4977-9304-4b1b39baecfb tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:05.692668 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-65736e54-8c6d-4977-9304-4b1b39baecfb tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:05.736328 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-b7355720-56c1-424b-9891-142d71c13e5b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:05.737126 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-b7355720-56c1-424b-9891-142d71c13e5b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:05.746361 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b7355720-56c1-424b-9891-142d71c13e5b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:05.746361 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b7355720-56c1-424b-9891-142d71c13e5b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:05.746361 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b7355720-56c1-424b-9891-142d71c13e5b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:05.747613 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b7355720-56c1-424b-9891-142d71c13e5b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:05.748495 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b7355720-56c1-424b-9891-142d71c13e5b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:05.750115 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b7355720-56c1-424b-9891-142d71c13e5b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:05.769057 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:44:05.851844 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-b7355720-56c1-424b-9891-142d71c13e5b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:05.860812 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-b7355720-56c1-424b-9891-142d71c13e5b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25" status: 200 len: 1293 microversion: 2.1 time: 0.130871 Aug 24 13:44:05.861820 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 326/657] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:05 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 => generated 1293 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:44:05.890958 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-65736e54-8c6d-4977-9304-4b1b39baecfb tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:05.902389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-65736e54-8c6d-4977-9304-4b1b39baecfb tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1734 microversion: 2.1 time: 0.229588 Aug 24 13:44:05.903177 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 332/658] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:05 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1734 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:44:06.885974 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-bd039f97-558e-42f2-ad1e-d4fa2b979c61 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:06.886610 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-bd039f97-558e-42f2-ad1e-d4fa2b979c61 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:06.894473 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd039f97-558e-42f2-ad1e-d4fa2b979c61 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:06.894971 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd039f97-558e-42f2-ad1e-d4fa2b979c61 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:06.895415 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd039f97-558e-42f2-ad1e-d4fa2b979c61 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:06.896122 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd039f97-558e-42f2-ad1e-d4fa2b979c61 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:06.896733 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd039f97-558e-42f2-ad1e-d4fa2b979c61 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:06.903063 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd039f97-558e-42f2-ad1e-d4fa2b979c61 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:06.933952 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d1f96250-bd99-41ab-9773-fc878d6b4ed6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:06.935024 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-d1f96250-bd99-41ab-9773-fc878d6b4ed6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:06.944747 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d1f96250-bd99-41ab-9773-fc878d6b4ed6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:06.945513 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d1f96250-bd99-41ab-9773-fc878d6b4ed6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:06.946149 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d1f96250-bd99-41ab-9773-fc878d6b4ed6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:06.946974 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d1f96250-bd99-41ab-9773-fc878d6b4ed6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:06.947524 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d1f96250-bd99-41ab-9773-fc878d6b4ed6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:06.948208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d1f96250-bd99-41ab-9773-fc878d6b4ed6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:07.010179 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-bd039f97-558e-42f2-ad1e-d4fa2b979c61 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:07.019300 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-bd039f97-558e-42f2-ad1e-d4fa2b979c61 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25" status: 200 len: 1293 microversion: 2.1 time: 0.138316 Aug 24 13:44:07.022613 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 327/659] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:06 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 => generated 1293 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:44:07.106723 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d1f96250-bd99-41ab-9773-fc878d6b4ed6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:07.115528 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-d1f96250-bd99-41ab-9773-fc878d6b4ed6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1734 microversion: 2.1 time: 0.188526 Aug 24 13:44:07.116110 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 333/660] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:06 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1734 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:44:08.048379 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-c5beaea4-8ec9-4451-a561-cdd4a5df0229 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:08.049088 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-c5beaea4-8ec9-4451-a561-cdd4a5df0229 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:08.060599 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c5beaea4-8ec9-4451-a561-cdd4a5df0229 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:08.061101 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c5beaea4-8ec9-4451-a561-cdd4a5df0229 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:08.061617 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c5beaea4-8ec9-4451-a561-cdd4a5df0229 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:08.063112 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c5beaea4-8ec9-4451-a561-cdd4a5df0229 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:08.063772 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c5beaea4-8ec9-4451-a561-cdd4a5df0229 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:08.064219 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c5beaea4-8ec9-4451-a561-cdd4a5df0229 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:08.141250 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-ff470c53-0c76-4f91-b042-73aed96f3f4b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:08.141942 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-ff470c53-0c76-4f91-b042-73aed96f3f4b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:08.149231 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ff470c53-0c76-4f91-b042-73aed96f3f4b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:08.149738 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ff470c53-0c76-4f91-b042-73aed96f3f4b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:08.150182 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ff470c53-0c76-4f91-b042-73aed96f3f4b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:08.150899 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ff470c53-0c76-4f91-b042-73aed96f3f4b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:08.151535 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ff470c53-0c76-4f91-b042-73aed96f3f4b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:08.151670 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-c5beaea4-8ec9-4451-a561-cdd4a5df0229 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:08.151964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ff470c53-0c76-4f91-b042-73aed96f3f4b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:08.160549 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-c5beaea4-8ec9-4451-a561-cdd4a5df0229 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25" status: 200 len: 1311 microversion: 2.1 time: 0.122112 Aug 24 13:44:08.161286 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 328/661] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:08 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 => generated 1311 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:44:08.366564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-ff470c53-0c76-4f91-b042-73aed96f3f4b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:08.382422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-ff470c53-0c76-4f91-b042-73aed96f3f4b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1734 microversion: 2.1 time: 0.247479 Aug 24 13:44:08.383392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 334/662] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:08 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1734 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:44:09.188157 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-0dd77fa7-198a-49f5-9ecd-75f155865255 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:09.194018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-0dd77fa7-198a-49f5-9ecd-75f155865255 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:09.203150 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0dd77fa7-198a-49f5-9ecd-75f155865255 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:09.204017 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0dd77fa7-198a-49f5-9ecd-75f155865255 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:09.204923 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0dd77fa7-198a-49f5-9ecd-75f155865255 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:09.206320 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0dd77fa7-198a-49f5-9ecd-75f155865255 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:09.207231 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0dd77fa7-198a-49f5-9ecd-75f155865255 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:09.208077 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0dd77fa7-198a-49f5-9ecd-75f155865255 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:09.409874 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-1c638326-a566-44f9-9b25-645269728a23 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:09.410948 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-1c638326-a566-44f9-9b25-645269728a23 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:09.421699 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1c638326-a566-44f9-9b25-645269728a23 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:09.422538 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1c638326-a566-44f9-9b25-645269728a23 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:09.423223 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1c638326-a566-44f9-9b25-645269728a23 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:09.424403 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1c638326-a566-44f9-9b25-645269728a23 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:09.425142 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1c638326-a566-44f9-9b25-645269728a23 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:09.425847 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1c638326-a566-44f9-9b25-645269728a23 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:09.462849 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0dd77fa7-198a-49f5-9ecd-75f155865255 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:09.471448 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-0dd77fa7-198a-49f5-9ecd-75f155865255 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25" status: 200 len: 1367 microversion: 2.1 time: 0.291758 Aug 24 13:44:09.472198 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 329/663] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:09 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:44:09.993997 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-1c638326-a566-44f9-9b25-645269728a23 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:10.010754 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-1c638326-a566-44f9-9b25-645269728a23 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1714 microversion: 2.1 time: 0.607341 Aug 24 13:44:10.011726 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 335/664] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:09 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1714 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:44:10.166437 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-7fef02de-c742-4145-a05a-cb2d38277aee tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:10.166964 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-7fef02de-c742-4145-a05a-cb2d38277aee tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:10.174173 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7fef02de-c742-4145-a05a-cb2d38277aee tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:10.174672 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7fef02de-c742-4145-a05a-cb2d38277aee tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:10.175118 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7fef02de-c742-4145-a05a-cb2d38277aee tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:10.175823 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7fef02de-c742-4145-a05a-cb2d38277aee tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:10.176375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7fef02de-c742-4145-a05a-cb2d38277aee tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:10.180628 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7fef02de-c742-4145-a05a-cb2d38277aee tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:10.293152 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-72d2e48d-2c51-483d-bf63-7ee3b186c14a req-64cf5768-132a-409e-a0b8-da1c51d8a0b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c70a39ae-b902-41c8-a735-c48983629b25", "tag": "a4155bd9-091b-424f-94b6-1d07874966f0"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:44:10.306134 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-72d2e48d-2c51-483d-bf63-7ee3b186c14a req-64cf5768-132a-409e-a0b8-da1c51d8a0b3 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:10.307714 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-72d2e48d-2c51-483d-bf63-7ee3b186c14a req-64cf5768-132a-409e-a0b8-da1c51d8a0b3 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:10.308380 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-72d2e48d-2c51-483d-bf63-7ee3b186c14a req-64cf5768-132a-409e-a0b8-da1c51d8a0b3 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:10.318372 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-7fef02de-c742-4145-a05a-cb2d38277aee tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] HTTP exception thrown: Cannot 'detach_volume' instance c1b259b6-2024-4b30-865d-17dadaef5406 while it is in vm_state rescued Aug 24 13:44:10.320022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-7fef02de-c742-4145-a05a-cb2d38277aee tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Request method failure captured: Aug 24 13:44:10.320022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: DELETE /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments/2c713c28-f537-4b3b-bc2b-74752e9b9d7a HTTP/1.1 Aug 24 13:44:10.320022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:44:10.320022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:44:10.320022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:44:10.320022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:44:10.320022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:44:10.320022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:44:10.320022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:44:10.320022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:44:10.320022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBio-vt113GyIGAINLSzOWx94ASYzerXaZEv5YREo1TToDpvzKyjcRowpvDgdJaKCc7yo4wyulaPEgIjpHjojWeA6p7mHKzAe5aa4pnmTJ73FsHansramwsQRGoDLdIydz44BXnhPycna7G2wYedVilx-YfOCQ3CHOnMCEUjDFP26dAs Aug 24 13:44:10.320022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:44:10.320022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:44:10.320022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:44:10.320022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:44:10.320022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:44:10.320022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:44:10.320022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 127e5da55b164ce68568c153fee58baf Aug 24 13:44:10.320022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1606015574 Aug 24 13:44:10.320022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:44:10.320022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:44:10.322742 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/127e5da55b164ce68568c153fee58baf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/127e5da55b164ce68568c153fee58baf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_127e5da55b164ce68568c153fee58baf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/127e5da55b164ce68568c153fee58baf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:44:10.322742 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1606015574 Aug 24 13:44:10.322742 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 127e5da55b164ce68568c153fee58baf Aug 24 13:44:10.322742 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1606015574 Aug 24 13:44:10.322742 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-ServerRescueNegativeTestJSON-1606015574-project Aug 24 13:44:10.322742 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:44:10.322742 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:44:10.322742 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: adb792e7246d42dface4aa52899a0ffc Aug 24 13:44:10.322742 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1606015574-project Aug 24 13:44:10.322742 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:44:10.322742 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Cannot 'detach_volume' instance c1b259b6-2024-4b30-865d-17dadaef5406 while it is in vm_state rescued Aug 24 13:44:10.324151 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'server_id': 'c1b259b6-2024-4b30-865d-17dadaef5406', 'id': '2c713c28-f537-4b3b-bc2b-74752e9b9d7a'} Aug 24 13:44:10.324151 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:44:10.324151 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:44:10.324151 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 13:44:10.324151 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 13:44:10.324151 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 13:44:10.324151 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 13:44:10.324151 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 13:44:10.324151 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 13:44:10.324151 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c1b259b6-2024-4b30-865d-17dadaef5406 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 13:44:10.324151 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:44:10.324151 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:44:10.324151 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:44:10.324151 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:44:10.324151 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:44:10.324151 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:44:10.324151 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:44:10.324151 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:44:10.324151 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:44:10.324151 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:44:10.326547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 13:44:10.326547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 13:44:10.326547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 13:44:10.326547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 13:44:10.326547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c1b259b6-2024-4b30-865d-17dadaef5406 while it is in vm_state rescued Aug 24 13:44:10.326547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:44:10.326547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:44:10.326547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:44:10.326547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:44:10.326547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:44:10.326547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:44:10.326547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:44:10.326547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:44:10.326547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c1b259b6-2024-4b30-865d-17dadaef5406 while it is in vm_state rescued Aug 24 13:44:10.326547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:44:10.326547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-7fef02de-c742-4145-a05a-cb2d38277aee tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Returning 409 to user: Cannot 'detach_volume' instance c1b259b6-2024-4b30-865d-17dadaef5406 while it is in vm_state rescued {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:44:10.331943 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-7fef02de-c742-4145-a05a-cb2d38277aee tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments/2c713c28-f537-4b3b-bc2b-74752e9b9d7a" status: 409 len: 152 microversion: 2.1 time: 0.159446 Aug 24 13:44:10.331943 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 330/665] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 13:44:10 2022] DELETE /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments/2c713c28-f537-4b3b-bc2b-74752e9b9d7a => generated 152 bytes in 161 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 13:44:10.333217 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-72d2e48d-2c51-483d-bf63-7ee3b186c14a req-64cf5768-132a-409e-a0b8-da1c51d8a0b3 service nova] Creating event network-changed:a4155bd9-091b-424f-94b6-1d07874966f0 for instance c70a39ae-b902-41c8-a735-c48983629b25 on hv-cinder-77957 Aug 24 13:44:10.339705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-192a24c8-f01e-4925-a015-c6293fdbf59d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:44:10.339705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-192a24c8-f01e-4925-a015-c6293fdbf59d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:10.340313 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-72d2e48d-2c51-483d-bf63-7ee3b186c14a req-64cf5768-132a-409e-a0b8-da1c51d8a0b3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053272 Aug 24 13:44:10.341523 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 336/666] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:44:10.341671 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-192a24c8-f01e-4925-a015-c6293fdbf59d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:10.342006 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-192a24c8-f01e-4925-a015-c6293fdbf59d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:10.342444 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-192a24c8-f01e-4925-a015-c6293fdbf59d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:10.343815 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-192a24c8-f01e-4925-a015-c6293fdbf59d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:10.344311 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-192a24c8-f01e-4925-a015-c6293fdbf59d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:10.344842 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-192a24c8-f01e-4925-a015-c6293fdbf59d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:10.496111 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-1a8f16fa-e0a2-440d-b0df-1556cfd81aca tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:10.496919 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-1a8f16fa-e0a2-440d-b0df-1556cfd81aca tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:10.503755 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1a8f16fa-e0a2-440d-b0df-1556cfd81aca tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:10.504281 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1a8f16fa-e0a2-440d-b0df-1556cfd81aca tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:10.504723 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1a8f16fa-e0a2-440d-b0df-1556cfd81aca tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:10.505421 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1a8f16fa-e0a2-440d-b0df-1556cfd81aca tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:10.505876 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1a8f16fa-e0a2-440d-b0df-1556cfd81aca tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:10.506298 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1a8f16fa-e0a2-440d-b0df-1556cfd81aca tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:10.560716 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-192a24c8-f01e-4925-a015-c6293fdbf59d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "POST /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/action" status: 202 len: 0 microversion: 2.1 time: 0.231833 Aug 24 13:44:10.561447 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 331/667] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 13:44:10 2022] POST /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 13:44:10.571299 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-935b4656-197d-419b-a404-85eb4954cea3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:10.571717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-935b4656-197d-419b-a404-85eb4954cea3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:10.579608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-935b4656-197d-419b-a404-85eb4954cea3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:10.580160 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-935b4656-197d-419b-a404-85eb4954cea3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:10.580689 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-935b4656-197d-419b-a404-85eb4954cea3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:10.581782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-935b4656-197d-419b-a404-85eb4954cea3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:10.582194 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-935b4656-197d-419b-a404-85eb4954cea3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:10.582610 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-935b4656-197d-419b-a404-85eb4954cea3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:10.939155 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-1a8f16fa-e0a2-440d-b0df-1556cfd81aca tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:10.947642 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-1a8f16fa-e0a2-440d-b0df-1556cfd81aca tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25" status: 200 len: 1367 microversion: 2.1 time: 0.456274 Aug 24 13:44:10.960547 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 337/668] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:10 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 => generated 1367 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:44:10.970025 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-935b4656-197d-419b-a404-85eb4954cea3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:10.980966 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-935b4656-197d-419b-a404-85eb4954cea3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1722 microversion: 2.1 time: 0.414256 Aug 24 13:44:10.981933 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 332/669] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:10 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1722 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:44:11.042317 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-2865cd69-14b5-44c1-a9e2-62b9ef0a8f42 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:11.043458 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-2865cd69-14b5-44c1-a9e2-62b9ef0a8f42 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:11.051873 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2865cd69-14b5-44c1-a9e2-62b9ef0a8f42 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:11.052449 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2865cd69-14b5-44c1-a9e2-62b9ef0a8f42 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:11.053213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2865cd69-14b5-44c1-a9e2-62b9ef0a8f42 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:11.054070 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2865cd69-14b5-44c1-a9e2-62b9ef0a8f42 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:11.054419 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2865cd69-14b5-44c1-a9e2-62b9ef0a8f42 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:11.054925 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2865cd69-14b5-44c1-a9e2-62b9ef0a8f42 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:11.084829 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-2865cd69-14b5-44c1-a9e2-62b9ef0a8f42 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4/ips" status: 200 len: 152 microversion: 2.20 time: 0.135442 Aug 24 13:44:11.085438 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 338/670] 10.222.0.73 () {60 vars in 1289 bytes} [Wed Aug 24 13:44:10 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4/ips => generated 152 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 13:44:11.973162 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-9d7cb97f-d830-42e2-a76c-cd0a028b3230 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:11.973773 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-9d7cb97f-d830-42e2-a76c-cd0a028b3230 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:11.980560 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d7cb97f-d830-42e2-a76c-cd0a028b3230 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:11.981178 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d7cb97f-d830-42e2-a76c-cd0a028b3230 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:11.981522 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d7cb97f-d830-42e2-a76c-cd0a028b3230 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:11.982220 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d7cb97f-d830-42e2-a76c-cd0a028b3230 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:11.982680 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d7cb97f-d830-42e2-a76c-cd0a028b3230 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:11.983101 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d7cb97f-d830-42e2-a76c-cd0a028b3230 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:12.005616 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-19589948-ccc5-4aeb-b5af-0f62a10e0d42 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:12.006586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-19589948-ccc5-4aeb-b5af-0f62a10e0d42 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:12.018470 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-19589948-ccc5-4aeb-b5af-0f62a10e0d42 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:12.019458 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-19589948-ccc5-4aeb-b5af-0f62a10e0d42 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:12.020399 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-19589948-ccc5-4aeb-b5af-0f62a10e0d42 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:12.021654 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-19589948-ccc5-4aeb-b5af-0f62a10e0d42 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:12.022558 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-19589948-ccc5-4aeb-b5af-0f62a10e0d42 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:12.023593 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-19589948-ccc5-4aeb-b5af-0f62a10e0d42 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:12.197493 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-9d7cb97f-d830-42e2-a76c-cd0a028b3230 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:12.208757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-9d7cb97f-d830-42e2-a76c-cd0a028b3230 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25" status: 200 len: 1367 microversion: 2.1 time: 0.239318 Aug 24 13:44:12.209599 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 333/671] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:11 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:44:12.236409 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-19589948-ccc5-4aeb-b5af-0f62a10e0d42 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:12.245830 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-19589948-ccc5-4aeb-b5af-0f62a10e0d42 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1722 microversion: 2.1 time: 0.246612 Aug 24 13:44:12.246422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 339/672] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:11 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:44:13.239168 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-0ed1b0fb-a795-42da-b64b-69ade5dbde7d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:13.239853 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-0ed1b0fb-a795-42da-b64b-69ade5dbde7d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:13.246752 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0ed1b0fb-a795-42da-b64b-69ade5dbde7d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:13.247247 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0ed1b0fb-a795-42da-b64b-69ade5dbde7d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:13.247687 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0ed1b0fb-a795-42da-b64b-69ade5dbde7d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:13.248441 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0ed1b0fb-a795-42da-b64b-69ade5dbde7d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:13.248978 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0ed1b0fb-a795-42da-b64b-69ade5dbde7d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:13.250148 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0ed1b0fb-a795-42da-b64b-69ade5dbde7d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:13.267910 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-4d725504-d237-4248-b965-60e674c80e06 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:13.268817 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-4d725504-d237-4248-b965-60e674c80e06 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:13.271187 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=2 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:44:13.272052 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=10 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:44:13.277638 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4d725504-d237-4248-b965-60e674c80e06 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:13.278143 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4d725504-d237-4248-b965-60e674c80e06 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:13.278657 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4d725504-d237-4248-b965-60e674c80e06 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:13.279350 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4d725504-d237-4248-b965-60e674c80e06 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:13.279811 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4d725504-d237-4248-b965-60e674c80e06 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:13.280519 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4d725504-d237-4248-b965-60e674c80e06 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:13.474376 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0ed1b0fb-a795-42da-b64b-69ade5dbde7d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:13.483828 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-0ed1b0fb-a795-42da-b64b-69ade5dbde7d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25" status: 200 len: 1367 microversion: 2.1 time: 0.247880 Aug 24 13:44:13.484733 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 334/673] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:13 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:44:13.489742 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-15b6163d-5e72-44bc-9d3e-f55367d84c68 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:44:13.490277 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-15b6163d-5e72-44bc-9d3e-f55367d84c68 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:13.491981 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4d725504-d237-4248-b965-60e674c80e06 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:13.496948 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-15b6163d-5e72-44bc-9d3e-f55367d84c68 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:13.497561 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-15b6163d-5e72-44bc-9d3e-f55367d84c68 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:13.498225 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-15b6163d-5e72-44bc-9d3e-f55367d84c68 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:13.499489 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-15b6163d-5e72-44bc-9d3e-f55367d84c68 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:13.500124 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-15b6163d-5e72-44bc-9d3e-f55367d84c68 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:13.500693 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-15b6163d-5e72-44bc-9d3e-f55367d84c68 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:13.505862 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-4d725504-d237-4248-b965-60e674c80e06 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1722 microversion: 2.1 time: 0.242094 Aug 24 13:44:13.507680 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 340/674] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:13 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:44:13.528244 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.objects.instance [None req-15b6163d-5e72-44bc-9d3e-f55367d84c68 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lazy-loading 'flavor' on Instance uuid ac19de18-372a-4cb9-bb59-0cb4b15e80b4 {{(pid=133014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:44:14.151003 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-15b6163d-5e72-44bc-9d3e-f55367d84c68 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "POST /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4/action" status: 202 len: 0 microversion: 2.20 time: 0.665210 Aug 24 13:44:14.151671 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 335/675] 10.222.0.73 () {62 vars in 1319 bytes} [Wed Aug 24 13:44:13 2022] POST /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4/action => generated 0 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:44:14.166746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-63c6cd0e-5274-4c6a-8a84-65c784870250 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:14.167422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-63c6cd0e-5274-4c6a-8a84-65c784870250 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:14.175022 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-63c6cd0e-5274-4c6a-8a84-65c784870250 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:14.175645 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-63c6cd0e-5274-4c6a-8a84-65c784870250 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:14.176249 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-63c6cd0e-5274-4c6a-8a84-65c784870250 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:14.177203 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-63c6cd0e-5274-4c6a-8a84-65c784870250 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:14.182695 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-63c6cd0e-5274-4c6a-8a84-65c784870250 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:14.183449 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-63c6cd0e-5274-4c6a-8a84-65c784870250 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:14.396946 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-63c6cd0e-5274-4c6a-8a84-65c784870250 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:14.406154 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-63c6cd0e-5274-4c6a-8a84-65c784870250 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:14.407681 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-63c6cd0e-5274-4c6a-8a84-65c784870250 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:14.409076 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-63c6cd0e-5274-4c6a-8a84-65c784870250 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1724 microversion: 2.20 time: 0.246409 Aug 24 13:44:14.409671 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 341/676] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:14 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:14.505798 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a3abce0f-49d5-494f-a896-1eb848b76159 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:14.506515 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a3abce0f-49d5-494f-a896-1eb848b76159 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:14.513709 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a3abce0f-49d5-494f-a896-1eb848b76159 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:14.520982 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a3abce0f-49d5-494f-a896-1eb848b76159 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:14.520982 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a3abce0f-49d5-494f-a896-1eb848b76159 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:14.520982 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a3abce0f-49d5-494f-a896-1eb848b76159 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:14.520982 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a3abce0f-49d5-494f-a896-1eb848b76159 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:14.521390 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a3abce0f-49d5-494f-a896-1eb848b76159 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:14.530624 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-6f30ded6-6d06-4045-9844-0e265481407e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:14.531856 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-6f30ded6-6d06-4045-9844-0e265481407e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:14.539095 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f30ded6-6d06-4045-9844-0e265481407e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:14.539636 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f30ded6-6d06-4045-9844-0e265481407e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:14.540196 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f30ded6-6d06-4045-9844-0e265481407e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:14.541000 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f30ded6-6d06-4045-9844-0e265481407e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:14.541747 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f30ded6-6d06-4045-9844-0e265481407e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:14.542712 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f30ded6-6d06-4045-9844-0e265481407e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:14.703706 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=4 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:44:14.823403 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a3abce0f-49d5-494f-a896-1eb848b76159 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:14.834440 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-6f30ded6-6d06-4045-9844-0e265481407e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:14.844499 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a3abce0f-49d5-494f-a896-1eb848b76159 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25" status: 200 len: 1367 microversion: 2.1 time: 0.342949 Aug 24 13:44:14.845584 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 336/677] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:14 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 => generated 1367 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:44:14.849339 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-6f30ded6-6d06-4045-9844-0e265481407e tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1722 microversion: 2.1 time: 0.324643 Aug 24 13:44:14.850814 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 342/678] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:14 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1722 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:44:15.433677 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-cb31442f-5c66-4113-bbf1-6f987023eea2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:15.434300 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-cb31442f-5c66-4113-bbf1-6f987023eea2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:15.438205 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:44:15.445129 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cb31442f-5c66-4113-bbf1-6f987023eea2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:15.445661 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cb31442f-5c66-4113-bbf1-6f987023eea2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:15.446107 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cb31442f-5c66-4113-bbf1-6f987023eea2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:15.446828 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cb31442f-5c66-4113-bbf1-6f987023eea2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:15.447288 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cb31442f-5c66-4113-bbf1-6f987023eea2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:15.447746 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cb31442f-5c66-4113-bbf1-6f987023eea2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:15.602190 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-cb31442f-5c66-4113-bbf1-6f987023eea2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:15.612397 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-cb31442f-5c66-4113-bbf1-6f987023eea2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:15.613047 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-cb31442f-5c66-4113-bbf1-6f987023eea2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:15.614239 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-cb31442f-5c66-4113-bbf1-6f987023eea2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1724 microversion: 2.20 time: 0.184715 Aug 24 13:44:15.614775 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 337/679] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:15 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:44:15.866436 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-dd1ec85d-2959-4cf7-83c7-df8ca558093d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:15.866973 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-dd1ec85d-2959-4cf7-83c7-df8ca558093d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:15.869556 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:44:15.875432 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-96b5f39b-6b90-47c3-8665-ab1312bf5061 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:15.875706 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dd1ec85d-2959-4cf7-83c7-df8ca558093d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:15.875978 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dd1ec85d-2959-4cf7-83c7-df8ca558093d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:15.876102 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-96b5f39b-6b90-47c3-8665-ab1312bf5061 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:15.876486 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dd1ec85d-2959-4cf7-83c7-df8ca558093d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:15.877231 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dd1ec85d-2959-4cf7-83c7-df8ca558093d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:15.877706 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dd1ec85d-2959-4cf7-83c7-df8ca558093d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:15.878172 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dd1ec85d-2959-4cf7-83c7-df8ca558093d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:15.882406 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-96b5f39b-6b90-47c3-8665-ab1312bf5061 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:15.886679 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-96b5f39b-6b90-47c3-8665-ab1312bf5061 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:15.886679 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-96b5f39b-6b90-47c3-8665-ab1312bf5061 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:15.886679 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-96b5f39b-6b90-47c3-8665-ab1312bf5061 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:15.886679 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-96b5f39b-6b90-47c3-8665-ab1312bf5061 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:15.887510 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-96b5f39b-6b90-47c3-8665-ab1312bf5061 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:16.087505 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-dd1ec85d-2959-4cf7-83c7-df8ca558093d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:16.091501 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-96b5f39b-6b90-47c3-8665-ab1312bf5061 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:16.097452 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-dd1ec85d-2959-4cf7-83c7-df8ca558093d tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25" status: 200 len: 1367 microversion: 2.1 time: 0.235148 Aug 24 13:44:16.103967 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 343/680] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:15 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:44:16.111262 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-96b5f39b-6b90-47c3-8665-ab1312bf5061 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1728 microversion: 2.1 time: 0.239887 Aug 24 13:44:16.111893 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 338/681] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:15 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1728 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:44:16.133679 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-7aeb811e-5216-4e93-84b1-06e41bb4a4ab tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:16.134252 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-7aeb811e-5216-4e93-84b1-06e41bb4a4ab tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:16.140806 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7aeb811e-5216-4e93-84b1-06e41bb4a4ab tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:16.141296 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7aeb811e-5216-4e93-84b1-06e41bb4a4ab tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:16.141761 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7aeb811e-5216-4e93-84b1-06e41bb4a4ab tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:16.142471 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7aeb811e-5216-4e93-84b1-06e41bb4a4ab tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:16.142926 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7aeb811e-5216-4e93-84b1-06e41bb4a4ab tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:16.143356 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7aeb811e-5216-4e93-84b1-06e41bb4a4ab tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:16.271758 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-7aeb811e-5216-4e93-84b1-06e41bb4a4ab tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.142420 Aug 24 13:44:16.272936 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 344/682] 10.222.0.73 () {58 vars in 1275 bytes} [Wed Aug 24 13:44:16 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:44:16.427988 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-df7a7ad7-7a6e-41fc-9879-b0dfd48125c8 req-06154edb-4892-4da4-92d9-10d2c336d0ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c70a39ae-b902-41c8-a735-c48983629b25", "name": "network-vif-plugged", "status": "completed", "tag": "a4155bd9-091b-424f-94b6-1d07874966f0"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:44:16.440370 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-df7a7ad7-7a6e-41fc-9879-b0dfd48125c8 req-06154edb-4892-4da4-92d9-10d2c336d0ee service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:16.440847 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-df7a7ad7-7a6e-41fc-9879-b0dfd48125c8 req-06154edb-4892-4da4-92d9-10d2c336d0ee service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:16.441289 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-df7a7ad7-7a6e-41fc-9879-b0dfd48125c8 req-06154edb-4892-4da4-92d9-10d2c336d0ee service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:16.455634 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-df7a7ad7-7a6e-41fc-9879-b0dfd48125c8 req-06154edb-4892-4da4-92d9-10d2c336d0ee service nova] Creating event network-vif-plugged:a4155bd9-091b-424f-94b6-1d07874966f0 for instance c70a39ae-b902-41c8-a735-c48983629b25 on hv-cinder-77957 Aug 24 13:44:16.461450 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-df7a7ad7-7a6e-41fc-9879-b0dfd48125c8 req-06154edb-4892-4da4-92d9-10d2c336d0ee service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125282 Aug 24 13:44:16.462332 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 339/683] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:44:16.638923 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b4386ea0-c722-46d9-8af1-0f6f2a9fa998 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:16.639738 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b4386ea0-c722-46d9-8af1-0f6f2a9fa998 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:16.647041 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b4386ea0-c722-46d9-8af1-0f6f2a9fa998 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:16.647600 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b4386ea0-c722-46d9-8af1-0f6f2a9fa998 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:16.647971 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b4386ea0-c722-46d9-8af1-0f6f2a9fa998 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:16.648907 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b4386ea0-c722-46d9-8af1-0f6f2a9fa998 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:16.649179 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b4386ea0-c722-46d9-8af1-0f6f2a9fa998 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:16.649631 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b4386ea0-c722-46d9-8af1-0f6f2a9fa998 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:16.826608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b4386ea0-c722-46d9-8af1-0f6f2a9fa998 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:16.846125 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b4386ea0-c722-46d9-8af1-0f6f2a9fa998 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:16.852436 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b4386ea0-c722-46d9-8af1-0f6f2a9fa998 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:16.852436 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b4386ea0-c722-46d9-8af1-0f6f2a9fa998 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1724 microversion: 2.20 time: 0.216365 Aug 24 13:44:16.852436 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 345/684] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:16 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:17.123095 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-d109e474-4119-4b07-b124-cf112fabb49f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:17.123850 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-d109e474-4119-4b07-b124-cf112fabb49f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:17.131097 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d109e474-4119-4b07-b124-cf112fabb49f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:17.131640 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d109e474-4119-4b07-b124-cf112fabb49f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:17.132832 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d109e474-4119-4b07-b124-cf112fabb49f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:17.132832 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d109e474-4119-4b07-b124-cf112fabb49f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:17.133660 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d109e474-4119-4b07-b124-cf112fabb49f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:17.134095 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d109e474-4119-4b07-b124-cf112fabb49f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:17.311738 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-d109e474-4119-4b07-b124-cf112fabb49f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:17.315848 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:44:17.322318 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-d109e474-4119-4b07-b124-cf112fabb49f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25" status: 200 len: 1367 microversion: 2.1 time: 0.203956 Aug 24 13:44:17.322904 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 340/685] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:17 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:44:17.548928 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-cc061e96-0b90-452d-9b38-fe10ff65f08e req-0b521be1-5dc4-41c8-b3c4-965970fcf2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1b259b6-2024-4b30-865d-17dadaef5406", "tag": "7aadab9f-67a3-4721-a287-269890ea0757"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:44:17.559502 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-cc061e96-0b90-452d-9b38-fe10ff65f08e req-0b521be1-5dc4-41c8-b3c4-965970fcf2e5 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:17.559982 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-cc061e96-0b90-452d-9b38-fe10ff65f08e req-0b521be1-5dc4-41c8-b3c4-965970fcf2e5 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:17.560503 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-cc061e96-0b90-452d-9b38-fe10ff65f08e req-0b521be1-5dc4-41c8-b3c4-965970fcf2e5 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:17.574610 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-cc061e96-0b90-452d-9b38-fe10ff65f08e req-0b521be1-5dc4-41c8-b3c4-965970fcf2e5 service nova] Creating event network-changed:7aadab9f-67a3-4721-a287-269890ea0757 for instance c1b259b6-2024-4b30-865d-17dadaef5406 on hv-cinder-77957 Aug 24 13:44:17.580833 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-cc061e96-0b90-452d-9b38-fe10ff65f08e req-0b521be1-5dc4-41c8-b3c4-965970fcf2e5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105130 Aug 24 13:44:17.581454 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 346/686] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:44:17.879616 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-ae20d34d-280f-4490-ae6b-273c1cb76994 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:17.880287 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-ae20d34d-280f-4490-ae6b-273c1cb76994 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:17.887067 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ae20d34d-280f-4490-ae6b-273c1cb76994 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:17.887534 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ae20d34d-280f-4490-ae6b-273c1cb76994 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:17.887977 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ae20d34d-280f-4490-ae6b-273c1cb76994 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:17.888713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ae20d34d-280f-4490-ae6b-273c1cb76994 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:17.889868 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ae20d34d-280f-4490-ae6b-273c1cb76994 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:17.890551 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ae20d34d-280f-4490-ae6b-273c1cb76994 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:18.114799 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-ae20d34d-280f-4490-ae6b-273c1cb76994 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:18.125301 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-ae20d34d-280f-4490-ae6b-273c1cb76994 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:18.126964 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-ae20d34d-280f-4490-ae6b-273c1cb76994 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:18.128212 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-ae20d34d-280f-4490-ae6b-273c1cb76994 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1724 microversion: 2.20 time: 0.252878 Aug 24 13:44:18.140542 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 341/687] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:17 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:44:18.348204 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-16155c55-d8b3-4ad0-8a4a-b5dac6363020 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:18.348979 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-16155c55-d8b3-4ad0-8a4a-b5dac6363020 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:18.355657 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-16155c55-d8b3-4ad0-8a4a-b5dac6363020 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:18.356140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-16155c55-d8b3-4ad0-8a4a-b5dac6363020 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:18.356602 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-16155c55-d8b3-4ad0-8a4a-b5dac6363020 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:18.357286 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-16155c55-d8b3-4ad0-8a4a-b5dac6363020 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:18.357734 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-16155c55-d8b3-4ad0-8a4a-b5dac6363020 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:18.358187 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-16155c55-d8b3-4ad0-8a4a-b5dac6363020 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:18.508340 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-16155c55-d8b3-4ad0-8a4a-b5dac6363020 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:18.516313 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-16155c55-d8b3-4ad0-8a4a-b5dac6363020 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25" status: 200 len: 1367 microversion: 2.1 time: 0.172517 Aug 24 13:44:18.516890 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 347/688] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:18 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:44:19.160600 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e54d3871-8aee-4a79-b856-d4448e1a0bf3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:19.161359 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-e54d3871-8aee-4a79-b856-d4448e1a0bf3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:19.168239 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e54d3871-8aee-4a79-b856-d4448e1a0bf3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:19.168741 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e54d3871-8aee-4a79-b856-d4448e1a0bf3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:19.169180 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e54d3871-8aee-4a79-b856-d4448e1a0bf3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:19.171817 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e54d3871-8aee-4a79-b856-d4448e1a0bf3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:19.171817 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e54d3871-8aee-4a79-b856-d4448e1a0bf3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:19.171817 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e54d3871-8aee-4a79-b856-d4448e1a0bf3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:19.306325 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e54d3871-8aee-4a79-b856-d4448e1a0bf3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:19.315551 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e54d3871-8aee-4a79-b856-d4448e1a0bf3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:19.317159 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e54d3871-8aee-4a79-b856-d4448e1a0bf3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:19.318389 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-e54d3871-8aee-4a79-b856-d4448e1a0bf3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1724 microversion: 2.20 time: 0.162395 Aug 24 13:44:19.318982 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 342/689] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:19 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:19.537808 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b9fb6dc2-ddc7-4a0c-9f87-5e4e8e169dac tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:19.538487 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b9fb6dc2-ddc7-4a0c-9f87-5e4e8e169dac tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:19.545225 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b9fb6dc2-ddc7-4a0c-9f87-5e4e8e169dac tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:19.546840 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b9fb6dc2-ddc7-4a0c-9f87-5e4e8e169dac tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:19.547397 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b9fb6dc2-ddc7-4a0c-9f87-5e4e8e169dac tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:19.548130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b9fb6dc2-ddc7-4a0c-9f87-5e4e8e169dac tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:19.548616 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b9fb6dc2-ddc7-4a0c-9f87-5e4e8e169dac tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:19.549046 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b9fb6dc2-ddc7-4a0c-9f87-5e4e8e169dac tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:19.595524 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-fdce8e37-c7d4-4d04-9918-fea46c11558e req-7dd1bafa-3d9a-4bc9-97ef-1034f1875cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1b259b6-2024-4b30-865d-17dadaef5406", "tag": "7aadab9f-67a3-4721-a287-269890ea0757"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:44:19.605182 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-fdce8e37-c7d4-4d04-9918-fea46c11558e req-7dd1bafa-3d9a-4bc9-97ef-1034f1875cc8 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:19.609304 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-fdce8e37-c7d4-4d04-9918-fea46c11558e req-7dd1bafa-3d9a-4bc9-97ef-1034f1875cc8 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:19.609304 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-fdce8e37-c7d4-4d04-9918-fea46c11558e req-7dd1bafa-3d9a-4bc9-97ef-1034f1875cc8 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:19.618337 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-fdce8e37-c7d4-4d04-9918-fea46c11558e req-7dd1bafa-3d9a-4bc9-97ef-1034f1875cc8 service nova] Creating event network-changed:7aadab9f-67a3-4721-a287-269890ea0757 for instance c1b259b6-2024-4b30-865d-17dadaef5406 on hv-cinder-77957 Aug 24 13:44:19.624218 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-fdce8e37-c7d4-4d04-9918-fea46c11558e req-7dd1bafa-3d9a-4bc9-97ef-1034f1875cc8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032407 Aug 24 13:44:19.624218 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 343/690] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:44:19.694514 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b9fb6dc2-ddc7-4a0c-9f87-5e4e8e169dac tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:19.702466 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b9fb6dc2-ddc7-4a0c-9f87-5e4e8e169dac tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25" status: 200 len: 1557 microversion: 2.1 time: 0.168756 Aug 24 13:44:19.703241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 348/691] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:19 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 => generated 1557 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:44:19.724134 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-acf92831-e183-4f8b-ae81-ff4c547ed296 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:19.724764 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-acf92831-e183-4f8b-ae81-ff4c547ed296 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:19.731182 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-acf92831-e183-4f8b-ae81-ff4c547ed296 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:19.731662 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-acf92831-e183-4f8b-ae81-ff4c547ed296 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:19.732095 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-acf92831-e183-4f8b-ae81-ff4c547ed296 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:19.732808 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-acf92831-e183-4f8b-ae81-ff4c547ed296 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:19.733916 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-acf92831-e183-4f8b-ae81-ff4c547ed296 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:19.734356 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-acf92831-e183-4f8b-ae81-ff4c547ed296 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:19.864004 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-acf92831-e183-4f8b-ae81-ff4c547ed296 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144058 Aug 24 13:44:19.864641 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 344/692] 10.222.0.73 () {58 vars in 1275 bytes} [Wed Aug 24 13:44:19 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:44:20.342450 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-45ae3c84-02e6-421b-bb27-8568cb148401 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:20.343607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-45ae3c84-02e6-421b-bb27-8568cb148401 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:20.350247 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-45ae3c84-02e6-421b-bb27-8568cb148401 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:20.350745 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-45ae3c84-02e6-421b-bb27-8568cb148401 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:20.351170 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-45ae3c84-02e6-421b-bb27-8568cb148401 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:20.351877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-45ae3c84-02e6-421b-bb27-8568cb148401 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:20.352393 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-45ae3c84-02e6-421b-bb27-8568cb148401 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:20.352800 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-45ae3c84-02e6-421b-bb27-8568cb148401 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:20.496791 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-45ae3c84-02e6-421b-bb27-8568cb148401 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:20.500580 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=100 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:44:20.507904 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-45ae3c84-02e6-421b-bb27-8568cb148401 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:20.509506 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-45ae3c84-02e6-421b-bb27-8568cb148401 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:20.510755 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-45ae3c84-02e6-421b-bb27-8568cb148401 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1724 microversion: 2.20 time: 0.172513 Aug 24 13:44:20.511609 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 349/693] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:20 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:21.537352 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-f361b3f0-43b9-4b66-826c-345380839ffc tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:21.538228 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-f361b3f0-43b9-4b66-826c-345380839ffc tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:21.544599 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f361b3f0-43b9-4b66-826c-345380839ffc tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:21.545109 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f361b3f0-43b9-4b66-826c-345380839ffc tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:21.545639 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f361b3f0-43b9-4b66-826c-345380839ffc tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:21.547026 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f361b3f0-43b9-4b66-826c-345380839ffc tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:21.547502 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f361b3f0-43b9-4b66-826c-345380839ffc tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:21.548044 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f361b3f0-43b9-4b66-826c-345380839ffc tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:21.640979 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-e5b9e927-e351-4903-b10d-d2d51c5a2109 req-ae20beec-505e-4f6a-bf73-de3ec9926431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c70a39ae-b902-41c8-a735-c48983629b25", "tag": "a4155bd9-091b-424f-94b6-1d07874966f0"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:44:21.652887 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-e5b9e927-e351-4903-b10d-d2d51c5a2109 req-ae20beec-505e-4f6a-bf73-de3ec9926431 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:21.653441 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-e5b9e927-e351-4903-b10d-d2d51c5a2109 req-ae20beec-505e-4f6a-bf73-de3ec9926431 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:21.653946 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-e5b9e927-e351-4903-b10d-d2d51c5a2109 req-ae20beec-505e-4f6a-bf73-de3ec9926431 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:21.668766 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-e5b9e927-e351-4903-b10d-d2d51c5a2109 req-ae20beec-505e-4f6a-bf73-de3ec9926431 service nova] Creating event network-changed:a4155bd9-091b-424f-94b6-1d07874966f0 for instance c70a39ae-b902-41c8-a735-c48983629b25 on hv-cinder-77957 Aug 24 13:44:21.674266 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-e5b9e927-e351-4903-b10d-d2d51c5a2109 req-ae20beec-505e-4f6a-bf73-de3ec9926431 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038054 Aug 24 13:44:21.675274 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 350/694] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:44:21.703593 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-f361b3f0-43b9-4b66-826c-345380839ffc tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:21.712263 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-f361b3f0-43b9-4b66-826c-345380839ffc tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:21.713819 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-f361b3f0-43b9-4b66-826c-345380839ffc tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:21.714990 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-f361b3f0-43b9-4b66-826c-345380839ffc tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1724 microversion: 2.20 time: 0.182281 Aug 24 13:44:21.715550 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 345/695] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:21 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:22.740259 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-4e2b8d8e-0015-491e-a8fd-c6a960acc3a7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:22.740878 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-4e2b8d8e-0015-491e-a8fd-c6a960acc3a7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:22.747462 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4e2b8d8e-0015-491e-a8fd-c6a960acc3a7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:22.747958 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4e2b8d8e-0015-491e-a8fd-c6a960acc3a7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:22.748430 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4e2b8d8e-0015-491e-a8fd-c6a960acc3a7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:22.749824 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4e2b8d8e-0015-491e-a8fd-c6a960acc3a7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:22.750584 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4e2b8d8e-0015-491e-a8fd-c6a960acc3a7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:22.751511 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4e2b8d8e-0015-491e-a8fd-c6a960acc3a7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:22.897304 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4e2b8d8e-0015-491e-a8fd-c6a960acc3a7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:22.906453 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4e2b8d8e-0015-491e-a8fd-c6a960acc3a7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:22.908117 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4e2b8d8e-0015-491e-a8fd-c6a960acc3a7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:22.909336 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-4e2b8d8e-0015-491e-a8fd-c6a960acc3a7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1724 microversion: 2.20 time: 0.174108 Aug 24 13:44:22.909945 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 351/696] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:22 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:23.932907 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-06cd08a4-424c-4866-8202-051cba6a2081 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:23.933510 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-06cd08a4-424c-4866-8202-051cba6a2081 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:23.941271 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-06cd08a4-424c-4866-8202-051cba6a2081 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:23.941773 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-06cd08a4-424c-4866-8202-051cba6a2081 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:23.942223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-06cd08a4-424c-4866-8202-051cba6a2081 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:23.942938 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-06cd08a4-424c-4866-8202-051cba6a2081 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:23.943391 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-06cd08a4-424c-4866-8202-051cba6a2081 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:23.943819 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-06cd08a4-424c-4866-8202-051cba6a2081 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:24.087114 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-06cd08a4-424c-4866-8202-051cba6a2081 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:24.097440 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-06cd08a4-424c-4866-8202-051cba6a2081 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:24.098940 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-06cd08a4-424c-4866-8202-051cba6a2081 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:24.100133 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-06cd08a4-424c-4866-8202-051cba6a2081 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1724 microversion: 2.20 time: 0.171248 Aug 24 13:44:24.100781 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 346/697] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:23 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:25.123608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-1f8a9e85-f866-41f2-bdef-fea1d6c63f23 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:25.124608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-1f8a9e85-f866-41f2-bdef-fea1d6c63f23 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:25.131588 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1f8a9e85-f866-41f2-bdef-fea1d6c63f23 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:25.132121 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1f8a9e85-f866-41f2-bdef-fea1d6c63f23 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:25.132590 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1f8a9e85-f866-41f2-bdef-fea1d6c63f23 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:25.133385 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1f8a9e85-f866-41f2-bdef-fea1d6c63f23 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:25.133853 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1f8a9e85-f866-41f2-bdef-fea1d6c63f23 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:25.134273 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1f8a9e85-f866-41f2-bdef-fea1d6c63f23 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:25.294583 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-1f8a9e85-f866-41f2-bdef-fea1d6c63f23 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:25.303660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-1f8a9e85-f866-41f2-bdef-fea1d6c63f23 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:25.305212 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-1f8a9e85-f866-41f2-bdef-fea1d6c63f23 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:25.306393 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-1f8a9e85-f866-41f2-bdef-fea1d6c63f23 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1724 microversion: 2.20 time: 0.186956 Aug 24 13:44:25.306971 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 352/698] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:25 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:44:26.331195 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-9967b433-7907-48d1-8ad9-98e730f265a5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:26.331803 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-9967b433-7907-48d1-8ad9-98e730f265a5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:26.338881 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9967b433-7907-48d1-8ad9-98e730f265a5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:26.339370 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9967b433-7907-48d1-8ad9-98e730f265a5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:26.339805 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9967b433-7907-48d1-8ad9-98e730f265a5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:26.340548 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9967b433-7907-48d1-8ad9-98e730f265a5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:26.341176 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9967b433-7907-48d1-8ad9-98e730f265a5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:26.341601 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9967b433-7907-48d1-8ad9-98e730f265a5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:26.485773 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-9967b433-7907-48d1-8ad9-98e730f265a5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:26.500988 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-9967b433-7907-48d1-8ad9-98e730f265a5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:26.502549 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-9967b433-7907-48d1-8ad9-98e730f265a5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:26.503715 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-9967b433-7907-48d1-8ad9-98e730f265a5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1724 microversion: 2.20 time: 0.177796 Aug 24 13:44:26.504306 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 347/699] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:26 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:27.527618 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-f2a402b6-448b-4216-a515-0bcd4bd33d9c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:27.528409 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-f2a402b6-448b-4216-a515-0bcd4bd33d9c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:27.535563 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f2a402b6-448b-4216-a515-0bcd4bd33d9c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:27.536258 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f2a402b6-448b-4216-a515-0bcd4bd33d9c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:27.536746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f2a402b6-448b-4216-a515-0bcd4bd33d9c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:27.539268 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f2a402b6-448b-4216-a515-0bcd4bd33d9c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:27.539753 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f2a402b6-448b-4216-a515-0bcd4bd33d9c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:27.540211 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f2a402b6-448b-4216-a515-0bcd4bd33d9c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:27.688411 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f2a402b6-448b-4216-a515-0bcd4bd33d9c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:27.697390 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f2a402b6-448b-4216-a515-0bcd4bd33d9c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:27.699040 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f2a402b6-448b-4216-a515-0bcd4bd33d9c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:27.700384 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-f2a402b6-448b-4216-a515-0bcd4bd33d9c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1724 microversion: 2.20 time: 0.176779 Aug 24 13:44:27.701003 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 353/700] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:27 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:28.724094 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-6184f8ad-20f5-4f80-8073-2e0bfca07cff tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:28.724713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-6184f8ad-20f5-4f80-8073-2e0bfca07cff tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:28.731458 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6184f8ad-20f5-4f80-8073-2e0bfca07cff tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:28.732040 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6184f8ad-20f5-4f80-8073-2e0bfca07cff tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:28.732514 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6184f8ad-20f5-4f80-8073-2e0bfca07cff tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:28.733373 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6184f8ad-20f5-4f80-8073-2e0bfca07cff tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:28.733843 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6184f8ad-20f5-4f80-8073-2e0bfca07cff tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:28.734266 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6184f8ad-20f5-4f80-8073-2e0bfca07cff tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:28.872617 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-6184f8ad-20f5-4f80-8073-2e0bfca07cff tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:28.881568 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-6184f8ad-20f5-4f80-8073-2e0bfca07cff tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:28.883074 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-6184f8ad-20f5-4f80-8073-2e0bfca07cff tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:28.884258 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-6184f8ad-20f5-4f80-8073-2e0bfca07cff tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1724 microversion: 2.20 time: 0.164304 Aug 24 13:44:28.884918 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 348/701] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:28 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:29.908796 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-2049a5f0-3be9-4bfc-b844-436d1d10223e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:29.909407 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-2049a5f0-3be9-4bfc-b844-436d1d10223e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:29.916273 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2049a5f0-3be9-4bfc-b844-436d1d10223e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:29.916764 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2049a5f0-3be9-4bfc-b844-436d1d10223e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:29.917205 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2049a5f0-3be9-4bfc-b844-436d1d10223e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:29.917903 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2049a5f0-3be9-4bfc-b844-436d1d10223e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:29.918352 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2049a5f0-3be9-4bfc-b844-436d1d10223e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:29.918772 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2049a5f0-3be9-4bfc-b844-436d1d10223e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:30.064584 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2049a5f0-3be9-4bfc-b844-436d1d10223e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:30.073305 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2049a5f0-3be9-4bfc-b844-436d1d10223e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:30.079818 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2049a5f0-3be9-4bfc-b844-436d1d10223e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:30.079818 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-2049a5f0-3be9-4bfc-b844-436d1d10223e tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1724 microversion: 2.20 time: 0.171927 Aug 24 13:44:30.079818 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 354/702] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:29 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:31.101195 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-fdd544f4-3ad0-4a05-ac07-e0e765f7f2c8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:31.101833 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-fdd544f4-3ad0-4a05-ac07-e0e765f7f2c8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:31.109353 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fdd544f4-3ad0-4a05-ac07-e0e765f7f2c8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:31.109843 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fdd544f4-3ad0-4a05-ac07-e0e765f7f2c8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:31.110276 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fdd544f4-3ad0-4a05-ac07-e0e765f7f2c8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:31.110973 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fdd544f4-3ad0-4a05-ac07-e0e765f7f2c8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:31.111424 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fdd544f4-3ad0-4a05-ac07-e0e765f7f2c8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:31.111843 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fdd544f4-3ad0-4a05-ac07-e0e765f7f2c8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:31.270279 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-fdd544f4-3ad0-4a05-ac07-e0e765f7f2c8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:31.276529 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-fdd544f4-3ad0-4a05-ac07-e0e765f7f2c8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:31.279888 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-fdd544f4-3ad0-4a05-ac07-e0e765f7f2c8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:31.282558 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-fdd544f4-3ad0-4a05-ac07-e0e765f7f2c8 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1745 microversion: 2.20 time: 0.185494 Aug 24 13:44:31.283650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 349/703] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:31 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1745 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:32.309330 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-bbc4d9cb-543a-41a6-94be-d93fd34554ed tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:32.310400 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-bbc4d9cb-543a-41a6-94be-d93fd34554ed tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:32.319120 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bbc4d9cb-543a-41a6-94be-d93fd34554ed tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:32.319721 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bbc4d9cb-543a-41a6-94be-d93fd34554ed tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:32.320325 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bbc4d9cb-543a-41a6-94be-d93fd34554ed tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:32.321133 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bbc4d9cb-543a-41a6-94be-d93fd34554ed tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:32.321746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bbc4d9cb-543a-41a6-94be-d93fd34554ed tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:32.322281 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bbc4d9cb-543a-41a6-94be-d93fd34554ed tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:32.494570 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-bbc4d9cb-543a-41a6-94be-d93fd34554ed tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:32.503536 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-bbc4d9cb-543a-41a6-94be-d93fd34554ed tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:32.505070 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-bbc4d9cb-543a-41a6-94be-d93fd34554ed tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:32.506255 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-bbc4d9cb-543a-41a6-94be-d93fd34554ed tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1740 microversion: 2.20 time: 0.203135 Aug 24 13:44:32.506815 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 355/704] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:32 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:33.533452 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-b06913d5-6622-44fa-bb43-6787dda96c3a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:33.534783 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-b06913d5-6622-44fa-bb43-6787dda96c3a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:33.542648 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b06913d5-6622-44fa-bb43-6787dda96c3a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:33.543527 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b06913d5-6622-44fa-bb43-6787dda96c3a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:33.544064 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b06913d5-6622-44fa-bb43-6787dda96c3a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:33.545118 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b06913d5-6622-44fa-bb43-6787dda96c3a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:33.546365 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b06913d5-6622-44fa-bb43-6787dda96c3a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:33.547108 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b06913d5-6622-44fa-bb43-6787dda96c3a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:33.727142 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-b06913d5-6622-44fa-bb43-6787dda96c3a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:33.741366 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-b06913d5-6622-44fa-bb43-6787dda96c3a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:33.744053 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-b06913d5-6622-44fa-bb43-6787dda96c3a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:33.745761 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-b06913d5-6622-44fa-bb43-6787dda96c3a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1740 microversion: 2.20 time: 0.218708 Aug 24 13:44:33.761467 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 350/705] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:33 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1740 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:34.260627 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-1a723882-411f-478e-83e4-3bb3397cb06e req-b51b6ee5-295f-423e-9060-9e3d5fc646be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac19de18-372a-4cb9-bb59-0cb4b15e80b4", "name": "network-vif-plugged", "status": "completed", "tag": "a11fdd6d-daa9-44f9-b1cc-eeb70dbbd497"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:44:34.281171 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-1a723882-411f-478e-83e4-3bb3397cb06e req-b51b6ee5-295f-423e-9060-9e3d5fc646be service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:34.282111 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-1a723882-411f-478e-83e4-3bb3397cb06e req-b51b6ee5-295f-423e-9060-9e3d5fc646be service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:34.283123 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-1a723882-411f-478e-83e4-3bb3397cb06e req-b51b6ee5-295f-423e-9060-9e3d5fc646be service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:34.307397 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-1a723882-411f-478e-83e4-3bb3397cb06e req-b51b6ee5-295f-423e-9060-9e3d5fc646be service nova] Creating event network-vif-plugged:a11fdd6d-daa9-44f9-b1cc-eeb70dbbd497 for instance ac19de18-372a-4cb9-bb59-0cb4b15e80b4 on hv-cinder-77957 Aug 24 13:44:34.314277 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-1a723882-411f-478e-83e4-3bb3397cb06e req-b51b6ee5-295f-423e-9060-9e3d5fc646be service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060860 Aug 24 13:44:34.315518 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 356/706] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:44:34.774869 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-238f49f3-885c-46cf-8e0c-7b042f33091a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:34.776290 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-238f49f3-885c-46cf-8e0c-7b042f33091a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:34.787622 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-238f49f3-885c-46cf-8e0c-7b042f33091a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:34.788527 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-238f49f3-885c-46cf-8e0c-7b042f33091a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:34.789197 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-238f49f3-885c-46cf-8e0c-7b042f33091a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:34.790203 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-238f49f3-885c-46cf-8e0c-7b042f33091a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:34.790847 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-238f49f3-885c-46cf-8e0c-7b042f33091a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:34.791271 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-238f49f3-885c-46cf-8e0c-7b042f33091a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:34.992203 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-238f49f3-885c-46cf-8e0c-7b042f33091a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:35.001390 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-238f49f3-885c-46cf-8e0c-7b042f33091a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:35.003229 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-238f49f3-885c-46cf-8e0c-7b042f33091a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:35.004652 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-238f49f3-885c-46cf-8e0c-7b042f33091a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1740 microversion: 2.20 time: 0.233529 Aug 24 13:44:35.005349 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 351/707] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:34 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1740 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:36.037311 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-7c26f2bc-61b5-44c3-aa08-9f34f4e015e4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:36.038605 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-7c26f2bc-61b5-44c3-aa08-9f34f4e015e4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:36.051194 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7c26f2bc-61b5-44c3-aa08-9f34f4e015e4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:36.052046 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7c26f2bc-61b5-44c3-aa08-9f34f4e015e4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:36.052903 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7c26f2bc-61b5-44c3-aa08-9f34f4e015e4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:36.054075 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7c26f2bc-61b5-44c3-aa08-9f34f4e015e4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:36.054597 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7c26f2bc-61b5-44c3-aa08-9f34f4e015e4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:36.055007 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7c26f2bc-61b5-44c3-aa08-9f34f4e015e4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:36.221259 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-7c26f2bc-61b5-44c3-aa08-9f34f4e015e4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:36.234029 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-7c26f2bc-61b5-44c3-aa08-9f34f4e015e4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:36.234029 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-7c26f2bc-61b5-44c3-aa08-9f34f4e015e4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:36.234029 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-7c26f2bc-61b5-44c3-aa08-9f34f4e015e4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1740 microversion: 2.20 time: 0.205562 Aug 24 13:44:36.235263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 357/708] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:36 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:37.262381 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-092a46c5-1c58-4a55-9df8-87e8a0f62a8f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:37.264281 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-092a46c5-1c58-4a55-9df8-87e8a0f62a8f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:37.276213 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-092a46c5-1c58-4a55-9df8-87e8a0f62a8f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:37.277273 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-092a46c5-1c58-4a55-9df8-87e8a0f62a8f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:37.278291 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-092a46c5-1c58-4a55-9df8-87e8a0f62a8f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:37.279496 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-092a46c5-1c58-4a55-9df8-87e8a0f62a8f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:37.281092 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-092a46c5-1c58-4a55-9df8-87e8a0f62a8f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:37.282228 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-092a46c5-1c58-4a55-9df8-87e8a0f62a8f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:37.463762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-092a46c5-1c58-4a55-9df8-87e8a0f62a8f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:37.484898 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-092a46c5-1c58-4a55-9df8-87e8a0f62a8f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:37.489401 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-092a46c5-1c58-4a55-9df8-87e8a0f62a8f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:37.490100 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-092a46c5-1c58-4a55-9df8-87e8a0f62a8f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1740 microversion: 2.20 time: 0.232673 Aug 24 13:44:37.490745 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 352/709] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:37 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:44:38.515552 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-f0b59e55-acfd-4418-a837-207e8cef5ab4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:38.516360 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-f0b59e55-acfd-4418-a837-207e8cef5ab4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:38.523118 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f0b59e55-acfd-4418-a837-207e8cef5ab4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:38.523585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f0b59e55-acfd-4418-a837-207e8cef5ab4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:38.524013 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f0b59e55-acfd-4418-a837-207e8cef5ab4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:38.524808 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f0b59e55-acfd-4418-a837-207e8cef5ab4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:38.525328 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f0b59e55-acfd-4418-a837-207e8cef5ab4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:38.525699 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f0b59e55-acfd-4418-a837-207e8cef5ab4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:38.684561 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f0b59e55-acfd-4418-a837-207e8cef5ab4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:38.694143 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f0b59e55-acfd-4418-a837-207e8cef5ab4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:38.696217 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f0b59e55-acfd-4418-a837-207e8cef5ab4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:38.697359 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-f0b59e55-acfd-4418-a837-207e8cef5ab4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1740 microversion: 2.20 time: 0.186949 Aug 24 13:44:38.712578 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 358/710] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:38 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:39.722627 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-dcb252f4-5dea-4e1f-b153-267e5cc5b2f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:39.723234 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-dcb252f4-5dea-4e1f-b153-267e5cc5b2f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:39.734775 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dcb252f4-5dea-4e1f-b153-267e5cc5b2f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:39.735304 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dcb252f4-5dea-4e1f-b153-267e5cc5b2f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:39.735744 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dcb252f4-5dea-4e1f-b153-267e5cc5b2f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:39.736485 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dcb252f4-5dea-4e1f-b153-267e5cc5b2f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:39.736942 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dcb252f4-5dea-4e1f-b153-267e5cc5b2f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:39.737366 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dcb252f4-5dea-4e1f-b153-267e5cc5b2f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:39.938708 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-dcb252f4-5dea-4e1f-b153-267e5cc5b2f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:39.950103 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-dcb252f4-5dea-4e1f-b153-267e5cc5b2f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:39.951706 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-dcb252f4-5dea-4e1f-b153-267e5cc5b2f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:39.952954 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-dcb252f4-5dea-4e1f-b153-267e5cc5b2f3 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1740 microversion: 2.20 time: 0.234426 Aug 24 13:44:39.953510 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 353/711] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:39 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:40.980455 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d3132e57-baf1-4bb7-80aa-3c851de0d090 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:40.981126 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-d3132e57-baf1-4bb7-80aa-3c851de0d090 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:40.990104 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d3132e57-baf1-4bb7-80aa-3c851de0d090 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:40.990597 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d3132e57-baf1-4bb7-80aa-3c851de0d090 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:40.991084 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d3132e57-baf1-4bb7-80aa-3c851de0d090 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:40.991737 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d3132e57-baf1-4bb7-80aa-3c851de0d090 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:40.992276 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d3132e57-baf1-4bb7-80aa-3c851de0d090 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:40.992707 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d3132e57-baf1-4bb7-80aa-3c851de0d090 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:41.189492 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d3132e57-baf1-4bb7-80aa-3c851de0d090 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:41.201362 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d3132e57-baf1-4bb7-80aa-3c851de0d090 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:41.202899 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d3132e57-baf1-4bb7-80aa-3c851de0d090 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:41.204082 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-d3132e57-baf1-4bb7-80aa-3c851de0d090 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1740 microversion: 2.20 time: 0.228652 Aug 24 13:44:41.204785 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 359/712] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:40 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:42.229682 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-97ca05ae-9f25-4e0f-b36f-86e8e5a7363a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:42.229682 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-97ca05ae-9f25-4e0f-b36f-86e8e5a7363a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:42.249015 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97ca05ae-9f25-4e0f-b36f-86e8e5a7363a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:42.249015 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97ca05ae-9f25-4e0f-b36f-86e8e5a7363a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:42.249015 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97ca05ae-9f25-4e0f-b36f-86e8e5a7363a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:42.249015 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97ca05ae-9f25-4e0f-b36f-86e8e5a7363a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:42.249722 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97ca05ae-9f25-4e0f-b36f-86e8e5a7363a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:42.249722 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97ca05ae-9f25-4e0f-b36f-86e8e5a7363a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:42.394996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-97ca05ae-9f25-4e0f-b36f-86e8e5a7363a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:42.404051 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-97ca05ae-9f25-4e0f-b36f-86e8e5a7363a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:42.406611 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-97ca05ae-9f25-4e0f-b36f-86e8e5a7363a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:42.407774 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-97ca05ae-9f25-4e0f-b36f-86e8e5a7363a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1740 microversion: 2.20 time: 0.183894 Aug 24 13:44:42.408373 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 354/713] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:42 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:43.434131 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b797df23-9a72-44db-8230-a54f778219d7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:43.434950 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b797df23-9a72-44db-8230-a54f778219d7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:43.442352 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b797df23-9a72-44db-8230-a54f778219d7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:43.442845 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b797df23-9a72-44db-8230-a54f778219d7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:43.443289 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b797df23-9a72-44db-8230-a54f778219d7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:43.443986 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b797df23-9a72-44db-8230-a54f778219d7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:43.444702 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b797df23-9a72-44db-8230-a54f778219d7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:43.445554 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b797df23-9a72-44db-8230-a54f778219d7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:43.602844 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b797df23-9a72-44db-8230-a54f778219d7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:43.611969 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b797df23-9a72-44db-8230-a54f778219d7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:43.613573 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b797df23-9a72-44db-8230-a54f778219d7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:43.615103 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b797df23-9a72-44db-8230-a54f778219d7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1740 microversion: 2.20 time: 0.186688 Aug 24 13:44:43.616164 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 360/714] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:43 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:44:44.640044 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-5ee85aa1-8e26-40a2-9c8e-506d27536fa5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:44.640698 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-5ee85aa1-8e26-40a2-9c8e-506d27536fa5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:44.647293 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5ee85aa1-8e26-40a2-9c8e-506d27536fa5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:44.647784 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5ee85aa1-8e26-40a2-9c8e-506d27536fa5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:44.648249 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5ee85aa1-8e26-40a2-9c8e-506d27536fa5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:44.648950 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5ee85aa1-8e26-40a2-9c8e-506d27536fa5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:44.649408 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5ee85aa1-8e26-40a2-9c8e-506d27536fa5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:44.649844 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5ee85aa1-8e26-40a2-9c8e-506d27536fa5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:44.790512 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-5ee85aa1-8e26-40a2-9c8e-506d27536fa5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:44.799241 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-5ee85aa1-8e26-40a2-9c8e-506d27536fa5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:44.800774 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-5ee85aa1-8e26-40a2-9c8e-506d27536fa5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:44.801928 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-5ee85aa1-8e26-40a2-9c8e-506d27536fa5 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1740 microversion: 2.20 time: 0.166511 Aug 24 13:44:44.802509 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 355/715] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:44 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:45.825377 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-22be1730-8df0-438c-a2d3-178a1a2e66f0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:45.826010 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-22be1730-8df0-438c-a2d3-178a1a2e66f0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:45.833529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-22be1730-8df0-438c-a2d3-178a1a2e66f0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:45.834024 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-22be1730-8df0-438c-a2d3-178a1a2e66f0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:45.834470 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-22be1730-8df0-438c-a2d3-178a1a2e66f0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:45.835180 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-22be1730-8df0-438c-a2d3-178a1a2e66f0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:45.835636 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-22be1730-8df0-438c-a2d3-178a1a2e66f0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:45.836061 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-22be1730-8df0-438c-a2d3-178a1a2e66f0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:45.970186 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-22be1730-8df0-438c-a2d3-178a1a2e66f0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:45.978501 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-22be1730-8df0-438c-a2d3-178a1a2e66f0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:45.980006 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-22be1730-8df0-438c-a2d3-178a1a2e66f0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:45.980572 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-812f8565-1a4e-457d-b64c-a6ac51e82d21 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:44:45.981117 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-812f8565-1a4e-457d-b64c-a6ac51e82d21 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:45.981251 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-22be1730-8df0-438c-a2d3-178a1a2e66f0 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1722 microversion: 2.20 time: 0.159858 Aug 24 13:44:45.981760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 361/716] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:45 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:45.985578 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_api:SELECT=38 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:44:45.989017 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-812f8565-1a4e-457d-b64c-a6ac51e82d21 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:45.989513 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-812f8565-1a4e-457d-b64c-a6ac51e82d21 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:45.989985 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-812f8565-1a4e-457d-b64c-a6ac51e82d21 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:45.990687 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-812f8565-1a4e-457d-b64c-a6ac51e82d21 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:45.991145 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-812f8565-1a4e-457d-b64c-a6ac51e82d21 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:45.991577 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-812f8565-1a4e-457d-b64c-a6ac51e82d21 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:46.014671 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.objects.instance [None req-812f8565-1a4e-457d-b64c-a6ac51e82d21 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lazy-loading 'flavor' on Instance uuid 1118fb04-6744-4b7c-b639-0081073ee53a {{(pid=133014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:44:46.222324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:44:46.308872 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-812f8565-1a4e-457d-b64c-a6ac51e82d21 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "POST /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a/action" status: 202 len: 0 microversion: 2.1 time: 0.332165 Aug 24 13:44:46.309475 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 356/717] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 13:44:45 2022] POST /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 13:44:46.318423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b9c1236f-c8a9-49b8-9d33-f6488a440063 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:46.319035 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b9c1236f-c8a9-49b8-9d33-f6488a440063 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:46.321176 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_api:SELECT=38 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:44:46.326608 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b9c1236f-c8a9-49b8-9d33-f6488a440063 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:46.327210 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b9c1236f-c8a9-49b8-9d33-f6488a440063 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:46.327642 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b9c1236f-c8a9-49b8-9d33-f6488a440063 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:46.328387 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b9c1236f-c8a9-49b8-9d33-f6488a440063 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:46.328842 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b9c1236f-c8a9-49b8-9d33-f6488a440063 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:46.329267 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b9c1236f-c8a9-49b8-9d33-f6488a440063 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:46.470370 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b9c1236f-c8a9-49b8-9d33-f6488a440063 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:46.478564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b9c1236f-c8a9-49b8-9d33-f6488a440063 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1570 microversion: 2.1 time: 0.164247 Aug 24 13:44:46.479190 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 362/718] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:46 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:44:47.005898 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-32e66961-55c7-489a-bfc1-914025112d17 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:47.006506 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-32e66961-55c7-489a-bfc1-914025112d17 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:47.013800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-32e66961-55c7-489a-bfc1-914025112d17 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:47.014448 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-32e66961-55c7-489a-bfc1-914025112d17 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:47.014879 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-32e66961-55c7-489a-bfc1-914025112d17 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:47.015568 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-32e66961-55c7-489a-bfc1-914025112d17 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:47.016019 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-32e66961-55c7-489a-bfc1-914025112d17 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:47.016471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-32e66961-55c7-489a-bfc1-914025112d17 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:47.159277 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-32e66961-55c7-489a-bfc1-914025112d17 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:47.167564 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-32e66961-55c7-489a-bfc1-914025112d17 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:47.169140 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-32e66961-55c7-489a-bfc1-914025112d17 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:47.170992 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-32e66961-55c7-489a-bfc1-914025112d17 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1722 microversion: 2.20 time: 0.169865 Aug 24 13:44:47.171566 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 357/719] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:46 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:47.501509 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-9ee6c829-8161-40fa-90ee-18123bdf8202 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:47.506694 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-9ee6c829-8161-40fa-90ee-18123bdf8202 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:47.509964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9ee6c829-8161-40fa-90ee-18123bdf8202 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:47.509964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9ee6c829-8161-40fa-90ee-18123bdf8202 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:47.510308 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9ee6c829-8161-40fa-90ee-18123bdf8202 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:47.510806 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9ee6c829-8161-40fa-90ee-18123bdf8202 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:47.511275 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9ee6c829-8161-40fa-90ee-18123bdf8202 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:47.511689 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9ee6c829-8161-40fa-90ee-18123bdf8202 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:47.655999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-9ee6c829-8161-40fa-90ee-18123bdf8202 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:47.664454 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-9ee6c829-8161-40fa-90ee-18123bdf8202 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1570 microversion: 2.1 time: 0.166895 Aug 24 13:44:47.665538 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 363/720] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:47 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:44:48.195731 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-0b51cce0-58aa-4c94-84fa-4a639126ec0d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:48.196377 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-0b51cce0-58aa-4c94-84fa-4a639126ec0d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:48.204386 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0b51cce0-58aa-4c94-84fa-4a639126ec0d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:48.204881 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0b51cce0-58aa-4c94-84fa-4a639126ec0d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:48.205323 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0b51cce0-58aa-4c94-84fa-4a639126ec0d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:48.206022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0b51cce0-58aa-4c94-84fa-4a639126ec0d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:48.206492 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0b51cce0-58aa-4c94-84fa-4a639126ec0d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:48.206918 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0b51cce0-58aa-4c94-84fa-4a639126ec0d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:48.355063 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0b51cce0-58aa-4c94-84fa-4a639126ec0d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:48.363401 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-bbac964d-f2b1-4853-8f5b-e51af794230c req-fabe5152-0ed0-482d-93a1-5860a52105a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac19de18-372a-4cb9-bb59-0cb4b15e80b4", "name": "network-vif-unplugged", "status": "completed", "tag": "a11fdd6d-daa9-44f9-b1cc-eeb70dbbd497"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:44:48.365616 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0b51cce0-58aa-4c94-84fa-4a639126ec0d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:48.367265 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0b51cce0-58aa-4c94-84fa-4a639126ec0d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:48.368498 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-0b51cce0-58aa-4c94-84fa-4a639126ec0d tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1725 microversion: 2.20 time: 0.176681 Aug 24 13:44:48.369283 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 358/721] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:48 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:48.378946 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-bbac964d-f2b1-4853-8f5b-e51af794230c req-fabe5152-0ed0-482d-93a1-5860a52105a9 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:48.379702 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-bbac964d-f2b1-4853-8f5b-e51af794230c req-fabe5152-0ed0-482d-93a1-5860a52105a9 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:48.380489 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-bbac964d-f2b1-4853-8f5b-e51af794230c req-fabe5152-0ed0-482d-93a1-5860a52105a9 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:48.392794 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-f43a8ab6-48d8-4f2f-95e6-4a2542f710b2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56544238-3b97-4114-89f4-1046fa41bba1"}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:44:48.395458 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-bbac964d-f2b1-4853-8f5b-e51af794230c req-fabe5152-0ed0-482d-93a1-5860a52105a9 service nova] Creating event network-vif-unplugged:a11fdd6d-daa9-44f9-b1cc-eeb70dbbd497 for instance ac19de18-372a-4cb9-bb59-0cb4b15e80b4 on hv-cinder-77957 Aug 24 13:44:48.395678 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-f43a8ab6-48d8-4f2f-95e6-4a2542f710b2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:48.400816 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-bbac964d-f2b1-4853-8f5b-e51af794230c req-fabe5152-0ed0-482d-93a1-5860a52105a9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040997 Aug 24 13:44:48.402177 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 364/722] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:44:48.402317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f43a8ab6-48d8-4f2f-95e6-4a2542f710b2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:48.402604 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f43a8ab6-48d8-4f2f-95e6-4a2542f710b2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:48.403127 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f43a8ab6-48d8-4f2f-95e6-4a2542f710b2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:48.403842 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f43a8ab6-48d8-4f2f-95e6-4a2542f710b2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:48.404897 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f43a8ab6-48d8-4f2f-95e6-4a2542f710b2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:48.405343 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f43a8ab6-48d8-4f2f-95e6-4a2542f710b2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:48.689449 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-50e96f80-3843-40ac-a38c-f77d66a8cd58 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:48.690153 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-50e96f80-3843-40ac-a38c-f77d66a8cd58 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:48.696548 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-50e96f80-3843-40ac-a38c-f77d66a8cd58 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:48.697118 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-50e96f80-3843-40ac-a38c-f77d66a8cd58 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:48.697559 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-50e96f80-3843-40ac-a38c-f77d66a8cd58 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:48.698255 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-50e96f80-3843-40ac-a38c-f77d66a8cd58 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:48.698703 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-50e96f80-3843-40ac-a38c-f77d66a8cd58 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:48.699122 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-50e96f80-3843-40ac-a38c-f77d66a8cd58 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:48.862618 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-50e96f80-3843-40ac-a38c-f77d66a8cd58 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:48.862618 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-50e96f80-3843-40ac-a38c-f77d66a8cd58 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1570 microversion: 2.1 time: 0.167886 Aug 24 13:44:48.862618 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 365/723] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:48 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:44:49.595317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-f43a8ab6-48d8-4f2f-95e6-4a2542f710b2 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "POST /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.207028 Aug 24 13:44:49.596769 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 359/724] 10.222.0.73 () {62 vars in 1364 bytes} [Wed Aug 24 13:44:48 2022] POST /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4/os-volume_attachments => generated 188 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 13:44:49.727199 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-98d09a75-17fd-42a7-9766-4576e2f8d8b9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:49.727919 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-98d09a75-17fd-42a7-9766-4576e2f8d8b9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:49.734564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-98d09a75-17fd-42a7-9766-4576e2f8d8b9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:49.735053 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-98d09a75-17fd-42a7-9766-4576e2f8d8b9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:49.735474 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-98d09a75-17fd-42a7-9766-4576e2f8d8b9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:49.736398 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-98d09a75-17fd-42a7-9766-4576e2f8d8b9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:49.736839 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-98d09a75-17fd-42a7-9766-4576e2f8d8b9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:49.737195 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-98d09a75-17fd-42a7-9766-4576e2f8d8b9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:49.875853 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-4217be5c-9aa7-4d44-abec-95bd158ed0e6 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:49.876595 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-4217be5c-9aa7-4d44-abec-95bd158ed0e6 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:49.883450 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4217be5c-9aa7-4d44-abec-95bd158ed0e6 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:49.883951 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4217be5c-9aa7-4d44-abec-95bd158ed0e6 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:49.884414 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4217be5c-9aa7-4d44-abec-95bd158ed0e6 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:49.885122 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4217be5c-9aa7-4d44-abec-95bd158ed0e6 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:49.885587 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4217be5c-9aa7-4d44-abec-95bd158ed0e6 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:49.886062 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4217be5c-9aa7-4d44-abec-95bd158ed0e6 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:50.031444 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-4217be5c-9aa7-4d44-abec-95bd158ed0e6 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:50.039304 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-4217be5c-9aa7-4d44-abec-95bd158ed0e6 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1570 microversion: 2.1 time: 0.168256 Aug 24 13:44:50.039876 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 360/725] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:49 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:44:50.203647 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:44:50.389680 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-98d09a75-17fd-42a7-9766-4576e2f8d8b9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4/os-volume_attachments/56544238-3b97-4114-89f4-1046fa41bba1" status: 202 len: 0 microversion: 2.20 time: 0.666388 Aug 24 13:44:50.390555 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 366/726] 10.222.0.73 () {60 vars in 1457 bytes} [Wed Aug 24 13:44:49 2022] DELETE /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4/os-volume_attachments/56544238-3b97-4114-89f4-1046fa41bba1 => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:44:50.460809 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-5157208b-d0b6-4ee5-a808-867027aca136 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:44:50.461330 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-5157208b-d0b6-4ee5-a808-867027aca136 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:50.469365 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5157208b-d0b6-4ee5-a808-867027aca136 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:50.469861 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5157208b-d0b6-4ee5-a808-867027aca136 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:50.470304 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5157208b-d0b6-4ee5-a808-867027aca136 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:50.471006 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5157208b-d0b6-4ee5-a808-867027aca136 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:50.471491 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5157208b-d0b6-4ee5-a808-867027aca136 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:50.471947 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5157208b-d0b6-4ee5-a808-867027aca136 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:50.570692 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-5157208b-d0b6-4ee5-a808-867027aca136 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=133014) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 13:44:50.900696 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-5157208b-d0b6-4ee5-a808-867027aca136 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "POST /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4/action" status: 202 len: 0 microversion: 2.20 time: 0.443743 Aug 24 13:44:50.904509 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 361/727] 10.222.0.73 () {62 vars in 1319 bytes} [Wed Aug 24 13:44:50 2022] POST /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:44:50.910548 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-949fe49f-3891-433e-a54f-35ba4d920e97 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:50.911155 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-949fe49f-3891-433e-a54f-35ba4d920e97 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:50.918893 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-949fe49f-3891-433e-a54f-35ba4d920e97 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:50.919364 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-949fe49f-3891-433e-a54f-35ba4d920e97 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:50.921458 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-949fe49f-3891-433e-a54f-35ba4d920e97 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:50.921458 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-949fe49f-3891-433e-a54f-35ba4d920e97 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:50.921458 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-949fe49f-3891-433e-a54f-35ba4d920e97 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:50.921860 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-949fe49f-3891-433e-a54f-35ba4d920e97 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:51.060972 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-949fe49f-3891-433e-a54f-35ba4d920e97 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:51.062524 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-b7d29723-e956-45d2-b57d-670f899ead16 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:51.063501 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-b7d29723-e956-45d2-b57d-670f899ead16 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:51.069979 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b7d29723-e956-45d2-b57d-670f899ead16 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:51.070680 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-949fe49f-3891-433e-a54f-35ba4d920e97 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:51.070851 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b7d29723-e956-45d2-b57d-670f899ead16 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:51.071116 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b7d29723-e956-45d2-b57d-670f899ead16 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:51.071813 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b7d29723-e956-45d2-b57d-670f899ead16 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:51.072214 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-949fe49f-3891-433e-a54f-35ba4d920e97 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:51.072351 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b7d29723-e956-45d2-b57d-670f899ead16 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:51.072760 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b7d29723-e956-45d2-b57d-670f899ead16 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:51.073433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-949fe49f-3891-433e-a54f-35ba4d920e97 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1673 microversion: 2.20 time: 0.166831 Aug 24 13:44:51.074212 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 367/728] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:50 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:51.213404 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-b7d29723-e956-45d2-b57d-670f899ead16 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:51.221538 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-b7d29723-e956-45d2-b57d-670f899ead16 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1570 microversion: 2.1 time: 0.163196 Aug 24 13:44:51.222111 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 362/729] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:51 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:44:52.097755 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-8fc4f863-3467-421d-bac7-b084d546ed61 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:52.098365 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-8fc4f863-3467-421d-bac7-b084d546ed61 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:52.105178 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8fc4f863-3467-421d-bac7-b084d546ed61 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:52.105673 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8fc4f863-3467-421d-bac7-b084d546ed61 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:52.106117 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8fc4f863-3467-421d-bac7-b084d546ed61 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:52.106820 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8fc4f863-3467-421d-bac7-b084d546ed61 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:52.108167 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8fc4f863-3467-421d-bac7-b084d546ed61 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:52.108821 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8fc4f863-3467-421d-bac7-b084d546ed61 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:52.243738 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-4b2269a7-36e7-44c5-b4ae-3c86a34d3fbe tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:52.244592 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-4b2269a7-36e7-44c5-b4ae-3c86a34d3fbe tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:52.253438 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4b2269a7-36e7-44c5-b4ae-3c86a34d3fbe tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:52.254080 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4b2269a7-36e7-44c5-b4ae-3c86a34d3fbe tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:52.254529 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4b2269a7-36e7-44c5-b4ae-3c86a34d3fbe tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:52.255241 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4b2269a7-36e7-44c5-b4ae-3c86a34d3fbe tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:52.255848 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4b2269a7-36e7-44c5-b4ae-3c86a34d3fbe tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:52.256475 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4b2269a7-36e7-44c5-b4ae-3c86a34d3fbe tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:52.259420 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-8fc4f863-3467-421d-bac7-b084d546ed61 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:52.269515 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-8fc4f863-3467-421d-bac7-b084d546ed61 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:52.271038 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-8fc4f863-3467-421d-bac7-b084d546ed61 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:52.272246 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-8fc4f863-3467-421d-bac7-b084d546ed61 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1673 microversion: 2.20 time: 0.178399 Aug 24 13:44:52.273896 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 368/730] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:52 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1673 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:52.404692 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-4b2269a7-36e7-44c5-b4ae-3c86a34d3fbe tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:52.416547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-4b2269a7-36e7-44c5-b4ae-3c86a34d3fbe tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1570 microversion: 2.1 time: 0.176778 Aug 24 13:44:52.417142 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 363/731] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:52 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:44:53.297297 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-e5329d22-1e6e-4abd-812c-16e016ab5012 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:53.297920 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-e5329d22-1e6e-4abd-812c-16e016ab5012 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:53.309392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e5329d22-1e6e-4abd-812c-16e016ab5012 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:53.309886 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e5329d22-1e6e-4abd-812c-16e016ab5012 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:53.310971 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e5329d22-1e6e-4abd-812c-16e016ab5012 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:53.311683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e5329d22-1e6e-4abd-812c-16e016ab5012 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:53.312131 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e5329d22-1e6e-4abd-812c-16e016ab5012 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:53.312578 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e5329d22-1e6e-4abd-812c-16e016ab5012 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:53.438125 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-fe565ef2-83ca-44b9-acce-95f4d79a2842 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:53.439236 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-fe565ef2-83ca-44b9-acce-95f4d79a2842 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:53.447188 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fe565ef2-83ca-44b9-acce-95f4d79a2842 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:53.447895 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fe565ef2-83ca-44b9-acce-95f4d79a2842 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:53.448539 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fe565ef2-83ca-44b9-acce-95f4d79a2842 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:53.449488 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fe565ef2-83ca-44b9-acce-95f4d79a2842 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:53.450155 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fe565ef2-83ca-44b9-acce-95f4d79a2842 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:53.450810 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fe565ef2-83ca-44b9-acce-95f4d79a2842 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:53.495288 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-e5329d22-1e6e-4abd-812c-16e016ab5012 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:53.504242 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-e5329d22-1e6e-4abd-812c-16e016ab5012 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:53.513318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-e5329d22-1e6e-4abd-812c-16e016ab5012 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:53.515408 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-e5329d22-1e6e-4abd-812c-16e016ab5012 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1731 microversion: 2.20 time: 0.222751 Aug 24 13:44:53.515973 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 369/732] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:53 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1731 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:53.651275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-fe565ef2-83ca-44b9-acce-95f4d79a2842 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:53.657069 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-fe565ef2-83ca-44b9-acce-95f4d79a2842 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1570 microversion: 2.1 time: 0.223138 Aug 24 13:44:53.657668 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 364/733] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:53 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1570 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:44:54.540020 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-2f9c6eef-6130-4c70-8193-ad9ddd60ce4b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:54.540970 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-2f9c6eef-6130-4c70-8193-ad9ddd60ce4b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:54.551432 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f9c6eef-6130-4c70-8193-ad9ddd60ce4b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:54.551929 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f9c6eef-6130-4c70-8193-ad9ddd60ce4b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:54.552407 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f9c6eef-6130-4c70-8193-ad9ddd60ce4b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:54.553128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f9c6eef-6130-4c70-8193-ad9ddd60ce4b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:54.553592 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f9c6eef-6130-4c70-8193-ad9ddd60ce4b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:54.554016 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f9c6eef-6130-4c70-8193-ad9ddd60ce4b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:54.679065 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-fcac4762-823e-4021-be08-ed2d82595bb8 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:54.680158 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-fcac4762-823e-4021-be08-ed2d82595bb8 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:54.688774 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fcac4762-823e-4021-be08-ed2d82595bb8 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:54.689277 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fcac4762-823e-4021-be08-ed2d82595bb8 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:54.689723 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fcac4762-823e-4021-be08-ed2d82595bb8 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:54.690543 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fcac4762-823e-4021-be08-ed2d82595bb8 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:54.690942 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fcac4762-823e-4021-be08-ed2d82595bb8 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:54.691378 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fcac4762-823e-4021-be08-ed2d82595bb8 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:54.701142 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2f9c6eef-6130-4c70-8193-ad9ddd60ce4b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:54.709890 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2f9c6eef-6130-4c70-8193-ad9ddd60ce4b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:54.715840 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2f9c6eef-6130-4c70-8193-ad9ddd60ce4b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:54.715840 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-2f9c6eef-6130-4c70-8193-ad9ddd60ce4b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1731 microversion: 2.20 time: 0.176394 Aug 24 13:44:54.715840 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 370/734] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:54 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:44:54.878290 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-fcac4762-823e-4021-be08-ed2d82595bb8 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:54.888820 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-fcac4762-823e-4021-be08-ed2d82595bb8 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1570 microversion: 2.1 time: 0.213742 Aug 24 13:44:54.903053 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 365/735] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:54 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1570 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:44:55.384606 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-6da8b1e6-09bd-48a9-a8f9-a960c7a8fbf4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:55.385112 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-6da8b1e6-09bd-48a9-a8f9-a960c7a8fbf4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:55.392519 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6da8b1e6-09bd-48a9-a8f9-a960c7a8fbf4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:55.393007 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6da8b1e6-09bd-48a9-a8f9-a960c7a8fbf4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:55.393462 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6da8b1e6-09bd-48a9-a8f9-a960c7a8fbf4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:55.394145 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6da8b1e6-09bd-48a9-a8f9-a960c7a8fbf4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:55.394871 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6da8b1e6-09bd-48a9-a8f9-a960c7a8fbf4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:55.395290 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6da8b1e6-09bd-48a9-a8f9-a960c7a8fbf4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:55.484656 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.objects.instance [None req-6da8b1e6-09bd-48a9-a8f9-a960c7a8fbf4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lazy-loading 'services' on Instance uuid c1b259b6-2024-4b30-865d-17dadaef5406 {{(pid=133015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:44:55.743917 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-3c00ace1-a618-4743-a704-4cf3a1923ef4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:55.746638 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-6da8b1e6-09bd-48a9-a8f9-a960c7a8fbf4 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments/2c713c28-f537-4b3b-bc2b-74752e9b9d7a" status: 202 len: 0 microversion: 2.1 time: 0.365885 Aug 24 13:44:55.748555 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-3c00ace1-a618-4743-a704-4cf3a1923ef4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:55.752046 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 371/736] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 13:44:55 2022] DELETE /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments/2c713c28-f537-4b3b-bc2b-74752e9b9d7a => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:44:55.764130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-6075aa09-c0f2-4910-9eee-14a0caeb274b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:55.766054 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3c00ace1-a618-4743-a704-4cf3a1923ef4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:55.766562 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3c00ace1-a618-4743-a704-4cf3a1923ef4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:55.766944 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-6075aa09-c0f2-4910-9eee-14a0caeb274b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:55.767041 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3c00ace1-a618-4743-a704-4cf3a1923ef4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:55.767742 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3c00ace1-a618-4743-a704-4cf3a1923ef4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:55.768229 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3c00ace1-a618-4743-a704-4cf3a1923ef4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:55.768671 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3c00ace1-a618-4743-a704-4cf3a1923ef4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:55.774089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6075aa09-c0f2-4910-9eee-14a0caeb274b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:55.774579 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6075aa09-c0f2-4910-9eee-14a0caeb274b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:55.775152 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6075aa09-c0f2-4910-9eee-14a0caeb274b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:55.775963 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6075aa09-c0f2-4910-9eee-14a0caeb274b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:55.776611 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6075aa09-c0f2-4910-9eee-14a0caeb274b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:55.777236 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6075aa09-c0f2-4910-9eee-14a0caeb274b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:55.810764 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-6075aa09-c0f2-4910-9eee-14a0caeb274b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051424 Aug 24 13:44:55.812577 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 372/737] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:44:55 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:44:55.910289 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-afe741e8-ec43-47f2-a637-12afb705020f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:55.910914 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-afe741e8-ec43-47f2-a637-12afb705020f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:55.917934 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-afe741e8-ec43-47f2-a637-12afb705020f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:55.918490 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-afe741e8-ec43-47f2-a637-12afb705020f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:55.918925 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-afe741e8-ec43-47f2-a637-12afb705020f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:55.919661 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-afe741e8-ec43-47f2-a637-12afb705020f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:55.920241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-afe741e8-ec43-47f2-a637-12afb705020f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:55.920823 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-afe741e8-ec43-47f2-a637-12afb705020f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:55.956392 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3c00ace1-a618-4743-a704-4cf3a1923ef4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:55.969359 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3c00ace1-a618-4743-a704-4cf3a1923ef4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:55.971150 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3c00ace1-a618-4743-a704-4cf3a1923ef4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:55.973261 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-3c00ace1-a618-4743-a704-4cf3a1923ef4 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1731 microversion: 2.20 time: 0.240569 Aug 24 13:44:55.973993 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 366/738] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:55 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1731 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:44:56.116860 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-afe741e8-ec43-47f2-a637-12afb705020f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:56.125786 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-afe741e8-ec43-47f2-a637-12afb705020f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1570 microversion: 2.1 time: 0.219284 Aug 24 13:44:56.126384 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 373/739] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:55 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1570 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:44:56.826105 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-506d6b12-4e60-4a08-b7cb-acf1cca53a91 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:56.829073 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-506d6b12-4e60-4a08-b7cb-acf1cca53a91 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:56.836681 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-506d6b12-4e60-4a08-b7cb-acf1cca53a91 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:56.843714 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-506d6b12-4e60-4a08-b7cb-acf1cca53a91 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:56.844537 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-506d6b12-4e60-4a08-b7cb-acf1cca53a91 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:56.845537 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-506d6b12-4e60-4a08-b7cb-acf1cca53a91 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:56.846378 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-506d6b12-4e60-4a08-b7cb-acf1cca53a91 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:56.847126 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-506d6b12-4e60-4a08-b7cb-acf1cca53a91 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:56.895048 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-506d6b12-4e60-4a08-b7cb-acf1cca53a91 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073927 Aug 24 13:44:56.898094 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 367/740] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:44:56 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:44:56.999227 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-43216110-44e4-4bb7-b896-cc7e0fe8a240 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:56.999907 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-43216110-44e4-4bb7-b896-cc7e0fe8a240 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:57.006315 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-43216110-44e4-4bb7-b896-cc7e0fe8a240 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:57.006718 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-43216110-44e4-4bb7-b896-cc7e0fe8a240 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:57.007154 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-43216110-44e4-4bb7-b896-cc7e0fe8a240 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:57.007852 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-43216110-44e4-4bb7-b896-cc7e0fe8a240 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:57.008340 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-43216110-44e4-4bb7-b896-cc7e0fe8a240 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:57.008769 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-43216110-44e4-4bb7-b896-cc7e0fe8a240 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:57.148370 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-9701eda1-b7f9-46c0-9141-f1fcebe05f00 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:57.149093 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-9701eda1-b7f9-46c0-9141-f1fcebe05f00 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:57.156704 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9701eda1-b7f9-46c0-9141-f1fcebe05f00 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:57.157329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9701eda1-b7f9-46c0-9141-f1fcebe05f00 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:57.158104 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9701eda1-b7f9-46c0-9141-f1fcebe05f00 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:57.158947 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9701eda1-b7f9-46c0-9141-f1fcebe05f00 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:57.159679 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9701eda1-b7f9-46c0-9141-f1fcebe05f00 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:57.160209 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9701eda1-b7f9-46c0-9141-f1fcebe05f00 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:57.177735 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-43216110-44e4-4bb7-b896-cc7e0fe8a240 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:57.188860 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-43216110-44e4-4bb7-b896-cc7e0fe8a240 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:57.190910 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-43216110-44e4-4bb7-b896-cc7e0fe8a240 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:57.192447 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-43216110-44e4-4bb7-b896-cc7e0fe8a240 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1731 microversion: 2.20 time: 0.198338 Aug 24 13:44:57.193252 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 374/741] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:56 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1731 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:57.290478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-7bd01f60-a93c-4591-a1e7-8a69e911a06e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:57.291918 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-7bd01f60-a93c-4591-a1e7-8a69e911a06e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:57.302908 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7bd01f60-a93c-4591-a1e7-8a69e911a06e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:57.304013 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7bd01f60-a93c-4591-a1e7-8a69e911a06e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:57.304939 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7bd01f60-a93c-4591-a1e7-8a69e911a06e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:57.306168 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7bd01f60-a93c-4591-a1e7-8a69e911a06e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:57.306859 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7bd01f60-a93c-4591-a1e7-8a69e911a06e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:57.307784 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7bd01f60-a93c-4591-a1e7-8a69e911a06e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:57.344047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-7bd01f60-a93c-4591-a1e7-8a69e911a06e tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25/ips" status: 200 len: 150 microversion: 2.1 time: 0.060077 Aug 24 13:44:57.351418 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 375/742] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 13:44:57 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25/ips => generated 150 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:44:57.360935 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-9701eda1-b7f9-46c0-9141-f1fcebe05f00 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:57.373144 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-9701eda1-b7f9-46c0-9141-f1fcebe05f00 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1570 microversion: 2.1 time: 0.229068 Aug 24 13:44:57.387794 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 368/743] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:57 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1570 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:44:57.911652 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-1bb746fe-6d7c-4550-96cb-aa0438c18ca3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:57.914063 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-1bb746fe-6d7c-4550-96cb-aa0438c18ca3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:57.922931 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1bb746fe-6d7c-4550-96cb-aa0438c18ca3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:57.923425 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1bb746fe-6d7c-4550-96cb-aa0438c18ca3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:57.923860 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1bb746fe-6d7c-4550-96cb-aa0438c18ca3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:57.924775 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1bb746fe-6d7c-4550-96cb-aa0438c18ca3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:57.925263 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1bb746fe-6d7c-4550-96cb-aa0438c18ca3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:57.925846 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1bb746fe-6d7c-4550-96cb-aa0438c18ca3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:57.966960 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-1bb746fe-6d7c-4550-96cb-aa0438c18ca3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061680 Aug 24 13:44:57.968557 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 376/744] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:44:57 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:44:58.217925 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-73ed988e-03b5-4a7d-9c86-b950308637fe tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:58.218634 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-73ed988e-03b5-4a7d-9c86-b950308637fe tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:58.225735 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-73ed988e-03b5-4a7d-9c86-b950308637fe tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:58.226219 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-73ed988e-03b5-4a7d-9c86-b950308637fe tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:58.226662 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-73ed988e-03b5-4a7d-9c86-b950308637fe tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:58.227344 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-73ed988e-03b5-4a7d-9c86-b950308637fe tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:58.227793 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-73ed988e-03b5-4a7d-9c86-b950308637fe tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:58.228234 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-73ed988e-03b5-4a7d-9c86-b950308637fe tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:58.248710 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:INSERT=5,nova_cell1:SELECT=90,nova_cell1:UPDATE=5 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:44:58.407326 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-e5ea8a7a-0b37-4b2f-874d-6f2e1b1676a5 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:58.409898 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-e5ea8a7a-0b37-4b2f-874d-6f2e1b1676a5 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:58.425210 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e5ea8a7a-0b37-4b2f-874d-6f2e1b1676a5 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:58.426360 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e5ea8a7a-0b37-4b2f-874d-6f2e1b1676a5 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:58.427033 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e5ea8a7a-0b37-4b2f-874d-6f2e1b1676a5 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:58.430333 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e5ea8a7a-0b37-4b2f-874d-6f2e1b1676a5 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:58.431203 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e5ea8a7a-0b37-4b2f-874d-6f2e1b1676a5 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:58.433146 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e5ea8a7a-0b37-4b2f-874d-6f2e1b1676a5 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:58.465879 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-73ed988e-03b5-4a7d-9c86-b950308637fe tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:58.488700 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-73ed988e-03b5-4a7d-9c86-b950308637fe tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:58.490489 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-73ed988e-03b5-4a7d-9c86-b950308637fe tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:58.494955 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-73ed988e-03b5-4a7d-9c86-b950308637fe tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1731 microversion: 2.20 time: 0.278752 Aug 24 13:44:58.509044 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 369/745] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:58 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1731 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:44:58.789684 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-e5ea8a7a-0b37-4b2f-874d-6f2e1b1676a5 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:58.789684 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-e5ea8a7a-0b37-4b2f-874d-6f2e1b1676a5 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1570 microversion: 2.1 time: 0.307250 Aug 24 13:44:58.789684 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 377/746] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:58 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1570 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:44:58.992126 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-54dab673-ffce-400d-a76b-07245eea572d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:58.997147 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-54dab673-ffce-400d-a76b-07245eea572d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:59.006362 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-54dab673-ffce-400d-a76b-07245eea572d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:59.007423 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-54dab673-ffce-400d-a76b-07245eea572d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:59.008234 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-54dab673-ffce-400d-a76b-07245eea572d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:59.010679 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-54dab673-ffce-400d-a76b-07245eea572d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:59.011915 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-54dab673-ffce-400d-a76b-07245eea572d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:59.018911 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-54dab673-ffce-400d-a76b-07245eea572d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:59.089765 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-54dab673-ffce-400d-a76b-07245eea572d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112438 Aug 24 13:44:59.090903 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 370/747] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:44:58 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:44:59.525639 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-6b99db76-dfce-435a-8d34-a2f1a4fbebec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:59.527066 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-6b99db76-dfce-435a-8d34-a2f1a4fbebec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:59.534997 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6b99db76-dfce-435a-8d34-a2f1a4fbebec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:59.535747 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6b99db76-dfce-435a-8d34-a2f1a4fbebec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:59.536402 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6b99db76-dfce-435a-8d34-a2f1a4fbebec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:59.537461 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6b99db76-dfce-435a-8d34-a2f1a4fbebec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:59.538121 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6b99db76-dfce-435a-8d34-a2f1a4fbebec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:59.538740 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6b99db76-dfce-435a-8d34-a2f1a4fbebec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:59.782483 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-eeccd3f5-aac0-46ff-858f-e2d74edc5a06 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:44:59.783745 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-eeccd3f5-aac0-46ff-858f-e2d74edc5a06 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:44:59.797424 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eeccd3f5-aac0-46ff-858f-e2d74edc5a06 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:59.798442 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eeccd3f5-aac0-46ff-858f-e2d74edc5a06 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:59.799296 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eeccd3f5-aac0-46ff-858f-e2d74edc5a06 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:59.800541 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eeccd3f5-aac0-46ff-858f-e2d74edc5a06 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:44:59.801255 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eeccd3f5-aac0-46ff-858f-e2d74edc5a06 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:44:59.802002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eeccd3f5-aac0-46ff-858f-e2d74edc5a06 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:44:59.827926 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-6b99db76-dfce-435a-8d34-a2f1a4fbebec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:59.855320 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-6b99db76-dfce-435a-8d34-a2f1a4fbebec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:59.858743 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-6b99db76-dfce-435a-8d34-a2f1a4fbebec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:44:59.863345 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-6b99db76-dfce-435a-8d34-a2f1a4fbebec tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1731 microversion: 2.20 time: 0.341228 Aug 24 13:44:59.881072 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 378/748] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:44:59 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1731 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:45:00.018044 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-eeccd3f5-aac0-46ff-858f-e2d74edc5a06 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:00.026160 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-eeccd3f5-aac0-46ff-858f-e2d74edc5a06 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1570 microversion: 2.1 time: 0.247947 Aug 24 13:45:00.026924 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 371/749] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:44:59 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1570 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:00.103626 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-303951d5-57c5-4fe9-a27b-cc59744020e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:00.105887 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-303951d5-57c5-4fe9-a27b-cc59744020e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:00.113031 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-303951d5-57c5-4fe9-a27b-cc59744020e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:00.120703 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-303951d5-57c5-4fe9-a27b-cc59744020e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:00.120703 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-303951d5-57c5-4fe9-a27b-cc59744020e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:00.120703 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-303951d5-57c5-4fe9-a27b-cc59744020e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:00.120703 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-303951d5-57c5-4fe9-a27b-cc59744020e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:00.121048 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-303951d5-57c5-4fe9-a27b-cc59744020e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:00.149205 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-303951d5-57c5-4fe9-a27b-cc59744020e6 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049555 Aug 24 13:45:00.149820 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 379/750] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:45:00 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:45:00.172109 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-63baf1f5-4ccb-4291-b636-605d9ffb0e64 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12cf4c11-348d-4d20-9160-293b6a46c915"}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:45:00.174668 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-63baf1f5-4ccb-4291-b636-605d9ffb0e64 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:00.180859 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-63baf1f5-4ccb-4291-b636-605d9ffb0e64 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:00.181352 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-63baf1f5-4ccb-4291-b636-605d9ffb0e64 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:00.181820 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-63baf1f5-4ccb-4291-b636-605d9ffb0e64 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:00.182649 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-63baf1f5-4ccb-4291-b636-605d9ffb0e64 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:00.183115 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-63baf1f5-4ccb-4291-b636-605d9ffb0e64 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:00.183543 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-63baf1f5-4ccb-4291-b636-605d9ffb0e64 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:00.904216 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-4c06b980-3884-4f32-a8ec-6f1c777fca1a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:00.904823 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-4c06b980-3884-4f32-a8ec-6f1c777fca1a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:00.911845 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4c06b980-3884-4f32-a8ec-6f1c777fca1a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:00.912676 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4c06b980-3884-4f32-a8ec-6f1c777fca1a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:00.913307 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4c06b980-3884-4f32-a8ec-6f1c777fca1a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:00.914417 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4c06b980-3884-4f32-a8ec-6f1c777fca1a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:00.915041 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4c06b980-3884-4f32-a8ec-6f1c777fca1a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:00.915712 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4c06b980-3884-4f32-a8ec-6f1c777fca1a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:01.070732 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4c06b980-3884-4f32-a8ec-6f1c777fca1a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:01.081650 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4c06b980-3884-4f32-a8ec-6f1c777fca1a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:01.083161 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4c06b980-3884-4f32-a8ec-6f1c777fca1a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:01.084388 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-4c06b980-3884-4f32-a8ec-6f1c777fca1a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1731 microversion: 2.20 time: 0.184241 Aug 24 13:45:01.085330 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 380/751] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:45:00 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:45:01.090221 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-665c20cc-21e7-47b4-8048-4f422f45be11 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:01.090840 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-665c20cc-21e7-47b4-8048-4f422f45be11 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:01.098229 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-665c20cc-21e7-47b4-8048-4f422f45be11 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:01.098729 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-665c20cc-21e7-47b4-8048-4f422f45be11 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:01.099171 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-665c20cc-21e7-47b4-8048-4f422f45be11 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:01.099888 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-665c20cc-21e7-47b4-8048-4f422f45be11 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:01.100386 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-665c20cc-21e7-47b4-8048-4f422f45be11 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:01.100813 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-665c20cc-21e7-47b4-8048-4f422f45be11 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:01.248209 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-665c20cc-21e7-47b4-8048-4f422f45be11 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:01.256274 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-665c20cc-21e7-47b4-8048-4f422f45be11 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1570 microversion: 2.1 time: 0.169782 Aug 24 13:45:01.256852 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 381/752] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:01 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:01.261798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-62b54f0b-42d3-4143-bc20-bef2537074a1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:01.264363 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-62b54f0b-42d3-4143-bc20-bef2537074a1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:01.270531 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-62b54f0b-42d3-4143-bc20-bef2537074a1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:01.271019 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-62b54f0b-42d3-4143-bc20-bef2537074a1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:01.271461 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-62b54f0b-42d3-4143-bc20-bef2537074a1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:01.272165 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-62b54f0b-42d3-4143-bc20-bef2537074a1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:01.272642 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-62b54f0b-42d3-4143-bc20-bef2537074a1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:01.273064 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-62b54f0b-42d3-4143-bc20-bef2537074a1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:01.280212 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:45:01.320085 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-62b54f0b-42d3-4143-bc20-bef2537074a1 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062163 Aug 24 13:45:01.320903 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 382/753] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:45:01 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:45:02.112320 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-0df08744-6e49-4dd4-ad3a-e96ffd9c50f9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:02.114695 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-0df08744-6e49-4dd4-ad3a-e96ffd9c50f9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:02.123372 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0df08744-6e49-4dd4-ad3a-e96ffd9c50f9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:02.124371 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0df08744-6e49-4dd4-ad3a-e96ffd9c50f9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:02.125039 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0df08744-6e49-4dd4-ad3a-e96ffd9c50f9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:02.125994 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0df08744-6e49-4dd4-ad3a-e96ffd9c50f9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:02.126699 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0df08744-6e49-4dd4-ad3a-e96ffd9c50f9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:02.127424 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0df08744-6e49-4dd4-ad3a-e96ffd9c50f9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:02.308339 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-0df08744-6e49-4dd4-ad3a-e96ffd9c50f9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:02.320057 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-0df08744-6e49-4dd4-ad3a-e96ffd9c50f9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:02.321619 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-0df08744-6e49-4dd4-ad3a-e96ffd9c50f9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:02.323282 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-0df08744-6e49-4dd4-ad3a-e96ffd9c50f9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1731 microversion: 2.20 time: 0.217112 Aug 24 13:45:02.324659 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 383/754] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:45:02 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1731 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:45:02.332018 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-57377e97-1b27-4176-a2b2-42098acbf127 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:02.332801 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-57377e97-1b27-4176-a2b2-42098acbf127 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:02.339365 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-57377e97-1b27-4176-a2b2-42098acbf127 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:02.340012 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-57377e97-1b27-4176-a2b2-42098acbf127 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:02.340493 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-57377e97-1b27-4176-a2b2-42098acbf127 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:02.344808 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-57377e97-1b27-4176-a2b2-42098acbf127 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:02.345597 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-57377e97-1b27-4176-a2b2-42098acbf127 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:02.346269 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-57377e97-1b27-4176-a2b2-42098acbf127 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:02.506298 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-57377e97-1b27-4176-a2b2-42098acbf127 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:02.515514 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-57377e97-1b27-4176-a2b2-42098acbf127 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1570 microversion: 2.1 time: 0.187315 Aug 24 13:45:02.529709 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 384/755] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:02 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1570 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:02.535011 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-c73e184a-c5b0-4c3a-b9d8-a99250c29972 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:02.537319 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-c73e184a-c5b0-4c3a-b9d8-a99250c29972 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:02.548300 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c73e184a-c5b0-4c3a-b9d8-a99250c29972 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:02.548794 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c73e184a-c5b0-4c3a-b9d8-a99250c29972 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:02.549229 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c73e184a-c5b0-4c3a-b9d8-a99250c29972 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:02.549927 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c73e184a-c5b0-4c3a-b9d8-a99250c29972 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:02.550374 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c73e184a-c5b0-4c3a-b9d8-a99250c29972 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:02.550788 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c73e184a-c5b0-4c3a-b9d8-a99250c29972 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:02.588609 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-c73e184a-c5b0-4c3a-b9d8-a99250c29972 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057408 Aug 24 13:45:02.589388 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 385/756] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:45:02 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:45:03.346802 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-1ae7ab61-3afc-4a5f-8877-a38a6c1577cf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:03.347545 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-1ae7ab61-3afc-4a5f-8877-a38a6c1577cf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:03.354711 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1ae7ab61-3afc-4a5f-8877-a38a6c1577cf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:03.355192 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1ae7ab61-3afc-4a5f-8877-a38a6c1577cf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:03.355625 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1ae7ab61-3afc-4a5f-8877-a38a6c1577cf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:03.356354 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1ae7ab61-3afc-4a5f-8877-a38a6c1577cf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:03.356852 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1ae7ab61-3afc-4a5f-8877-a38a6c1577cf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:03.357323 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1ae7ab61-3afc-4a5f-8877-a38a6c1577cf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:03.595439 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-1ae7ab61-3afc-4a5f-8877-a38a6c1577cf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:03.604380 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-1ae7ab61-3afc-4a5f-8877-a38a6c1577cf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:03.605695 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-1ae7ab61-3afc-4a5f-8877-a38a6c1577cf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:03.607431 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-1ae7ab61-3afc-4a5f-8877-a38a6c1577cf tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1731 microversion: 2.20 time: 0.264510 Aug 24 13:45:03.608098 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 386/757] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:45:03 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1731 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:45:03.620569 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-408191e9-dcbb-4fe2-bf06-c966b4772870 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:03.620569 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-408191e9-dcbb-4fe2-bf06-c966b4772870 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:03.620569 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-408191e9-dcbb-4fe2-bf06-c966b4772870 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:03.620569 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-408191e9-dcbb-4fe2-bf06-c966b4772870 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:03.620969 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-408191e9-dcbb-4fe2-bf06-c966b4772870 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:03.621681 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-408191e9-dcbb-4fe2-bf06-c966b4772870 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:03.622135 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-408191e9-dcbb-4fe2-bf06-c966b4772870 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:03.623300 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-408191e9-dcbb-4fe2-bf06-c966b4772870 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:03.774809 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-408191e9-dcbb-4fe2-bf06-c966b4772870 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:03.782814 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-408191e9-dcbb-4fe2-bf06-c966b4772870 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1570 microversion: 2.1 time: 0.173712 Aug 24 13:45:03.783379 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 387/758] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:03 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:03.787879 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-3b5f3ff1-da0c-4933-82ad-71f23d9cfe6b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:03.790039 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-3b5f3ff1-da0c-4933-82ad-71f23d9cfe6b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:03.796926 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3b5f3ff1-da0c-4933-82ad-71f23d9cfe6b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:03.801139 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3b5f3ff1-da0c-4933-82ad-71f23d9cfe6b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:03.801139 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3b5f3ff1-da0c-4933-82ad-71f23d9cfe6b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:03.801139 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3b5f3ff1-da0c-4933-82ad-71f23d9cfe6b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:03.801139 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3b5f3ff1-da0c-4933-82ad-71f23d9cfe6b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:03.801528 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3b5f3ff1-da0c-4933-82ad-71f23d9cfe6b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:03.830635 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-3b5f3ff1-da0c-4933-82ad-71f23d9cfe6b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046212 Aug 24 13:45:03.831208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 388/759] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:45:03 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:45:04.177173 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-63baf1f5-4ccb-4291-b636-605d9ffb0e64 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "POST /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.009829 Aug 24 13:45:04.177821 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 372/760] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 13:45:00 2022] POST /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25/os-volume_attachments => generated 194 bytes in 4012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:45:04.632510 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-dc26248f-c29f-45f5-be9c-fd16bcd3fd34 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:04.633413 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-dc26248f-c29f-45f5-be9c-fd16bcd3fd34 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:04.640074 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dc26248f-c29f-45f5-be9c-fd16bcd3fd34 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:04.640582 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dc26248f-c29f-45f5-be9c-fd16bcd3fd34 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:04.641010 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dc26248f-c29f-45f5-be9c-fd16bcd3fd34 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:04.641686 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dc26248f-c29f-45f5-be9c-fd16bcd3fd34 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:04.642133 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dc26248f-c29f-45f5-be9c-fd16bcd3fd34 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:04.642545 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dc26248f-c29f-45f5-be9c-fd16bcd3fd34 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:04.772332 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-dc26248f-c29f-45f5-be9c-fd16bcd3fd34 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:04.781656 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-dc26248f-c29f-45f5-be9c-fd16bcd3fd34 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:04.783161 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-dc26248f-c29f-45f5-be9c-fd16bcd3fd34 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:04.784534 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-dc26248f-c29f-45f5-be9c-fd16bcd3fd34 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1731 microversion: 2.20 time: 0.155911 Aug 24 13:45:04.786412 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 389/761] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:45:04 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:45:04.806102 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-7aff1b7a-daf6-4a44-a72f-bcde9735a89e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:04.809276 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-7aff1b7a-daf6-4a44-a72f-bcde9735a89e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:04.815774 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7aff1b7a-daf6-4a44-a72f-bcde9735a89e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:04.816305 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7aff1b7a-daf6-4a44-a72f-bcde9735a89e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:04.816749 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7aff1b7a-daf6-4a44-a72f-bcde9735a89e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:04.817459 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7aff1b7a-daf6-4a44-a72f-bcde9735a89e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:04.817921 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7aff1b7a-daf6-4a44-a72f-bcde9735a89e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:04.818354 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7aff1b7a-daf6-4a44-a72f-bcde9735a89e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:04.857825 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-18684953-b655-45ee-83a6-823ca61680c8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:04.857825 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-18684953-b655-45ee-83a6-823ca61680c8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:04.857825 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-18684953-b655-45ee-83a6-823ca61680c8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:04.857825 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-18684953-b655-45ee-83a6-823ca61680c8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:04.858238 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-18684953-b655-45ee-83a6-823ca61680c8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:04.858625 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-18684953-b655-45ee-83a6-823ca61680c8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:04.859299 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-18684953-b655-45ee-83a6-823ca61680c8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:04.859733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-18684953-b655-45ee-83a6-823ca61680c8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:04.898006 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-18684953-b655-45ee-83a6-823ca61680c8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059385 Aug 24 13:45:04.898607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 390/762] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:45:04 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:45:05.028061 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-7aff1b7a-daf6-4a44-a72f-bcde9735a89e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:05.037128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-7aff1b7a-daf6-4a44-a72f-bcde9735a89e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1570 microversion: 2.1 time: 0.235448 Aug 24 13:45:05.037726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 373/763] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:04 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1570 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:05.808921 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-036170d7-8e95-465d-9357-61eb6813c337 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:05.809527 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-036170d7-8e95-465d-9357-61eb6813c337 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:05.816963 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-036170d7-8e95-465d-9357-61eb6813c337 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:05.817438 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-036170d7-8e95-465d-9357-61eb6813c337 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:05.817872 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-036170d7-8e95-465d-9357-61eb6813c337 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:05.818554 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-036170d7-8e95-465d-9357-61eb6813c337 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:05.819010 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-036170d7-8e95-465d-9357-61eb6813c337 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:05.819422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-036170d7-8e95-465d-9357-61eb6813c337 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:05.910906 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-91175517-b8e5-400d-94ca-8baae5d160b8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:05.913239 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-91175517-b8e5-400d-94ca-8baae5d160b8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:05.920500 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-91175517-b8e5-400d-94ca-8baae5d160b8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:05.920996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-91175517-b8e5-400d-94ca-8baae5d160b8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:05.921650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-91175517-b8e5-400d-94ca-8baae5d160b8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:05.922364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-91175517-b8e5-400d-94ca-8baae5d160b8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:05.922819 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-91175517-b8e5-400d-94ca-8baae5d160b8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:05.923242 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-91175517-b8e5-400d-94ca-8baae5d160b8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:05.952758 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-036170d7-8e95-465d-9357-61eb6813c337 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:05.954744 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-91175517-b8e5-400d-94ca-8baae5d160b8 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047724 Aug 24 13:45:05.955329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 374/764] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:45:05 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:45:05.960988 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-036170d7-8e95-465d-9357-61eb6813c337 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:05.962490 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-036170d7-8e95-465d-9357-61eb6813c337 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:05.963641 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-036170d7-8e95-465d-9357-61eb6813c337 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1731 microversion: 2.20 time: 0.158666 Aug 24 13:45:05.964226 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 391/765] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:45:05 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:45:06.059078 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-0e34d6ad-4eed-4f89-ae53-5a0f534a2ac0 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:06.059715 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-0e34d6ad-4eed-4f89-ae53-5a0f534a2ac0 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:06.067052 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0e34d6ad-4eed-4f89-ae53-5a0f534a2ac0 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:06.067534 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0e34d6ad-4eed-4f89-ae53-5a0f534a2ac0 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:06.067968 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0e34d6ad-4eed-4f89-ae53-5a0f534a2ac0 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:06.068706 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0e34d6ad-4eed-4f89-ae53-5a0f534a2ac0 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:06.069160 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0e34d6ad-4eed-4f89-ae53-5a0f534a2ac0 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:06.069584 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0e34d6ad-4eed-4f89-ae53-5a0f534a2ac0 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:06.206350 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0e34d6ad-4eed-4f89-ae53-5a0f534a2ac0 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:06.214311 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-0e34d6ad-4eed-4f89-ae53-5a0f534a2ac0 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1570 microversion: 2.1 time: 0.159085 Aug 24 13:45:06.214887 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 375/766] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:06 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:06.967212 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-7ac2ec0d-ab1b-4ff2-8f85-46dd6b62c48f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:06.969354 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-7ac2ec0d-ab1b-4ff2-8f85-46dd6b62c48f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:06.975823 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7ac2ec0d-ab1b-4ff2-8f85-46dd6b62c48f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:06.976334 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7ac2ec0d-ab1b-4ff2-8f85-46dd6b62c48f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:06.976761 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7ac2ec0d-ab1b-4ff2-8f85-46dd6b62c48f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:06.977436 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7ac2ec0d-ab1b-4ff2-8f85-46dd6b62c48f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:06.977884 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7ac2ec0d-ab1b-4ff2-8f85-46dd6b62c48f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:06.978298 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7ac2ec0d-ab1b-4ff2-8f85-46dd6b62c48f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:06.986043 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-ba4b519a-0ec2-4f55-ba4a-ae9c612a11f9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:06.986686 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-ba4b519a-0ec2-4f55-ba4a-ae9c612a11f9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:06.993227 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ba4b519a-0ec2-4f55-ba4a-ae9c612a11f9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:06.994314 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ba4b519a-0ec2-4f55-ba4a-ae9c612a11f9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:06.994314 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ba4b519a-0ec2-4f55-ba4a-ae9c612a11f9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:06.994845 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ba4b519a-0ec2-4f55-ba4a-ae9c612a11f9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:06.995335 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ba4b519a-0ec2-4f55-ba4a-ae9c612a11f9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:06.995711 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ba4b519a-0ec2-4f55-ba4a-ae9c612a11f9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:07.017321 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-7ac2ec0d-ab1b-4ff2-8f85-46dd6b62c48f tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053137 Aug 24 13:45:07.017321 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 392/767] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:45:06 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 13:45:07.109186 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-7b58771d-1cee-43e7-b1ae-76e020a31bd2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:07.109790 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-7b58771d-1cee-43e7-b1ae-76e020a31bd2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:07.118167 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7b58771d-1cee-43e7-b1ae-76e020a31bd2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:07.118939 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7b58771d-1cee-43e7-b1ae-76e020a31bd2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:07.119420 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7b58771d-1cee-43e7-b1ae-76e020a31bd2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:07.120276 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7b58771d-1cee-43e7-b1ae-76e020a31bd2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:07.120793 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7b58771d-1cee-43e7-b1ae-76e020a31bd2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:07.121416 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7b58771d-1cee-43e7-b1ae-76e020a31bd2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:07.149575 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-7b58771d-1cee-43e7-b1ae-76e020a31bd2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Going to try to terminate instance {{(pid=133015) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 13:45:07.168018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-ba4b519a-0ec2-4f55-ba4a-ae9c612a11f9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:07.176555 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-ba4b519a-0ec2-4f55-ba4a-ae9c612a11f9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:07.178054 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-ba4b519a-0ec2-4f55-ba4a-ae9c612a11f9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:07.179206 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-ba4b519a-0ec2-4f55-ba4a-ae9c612a11f9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1731 microversion: 2.20 time: 0.197208 Aug 24 13:45:07.179764 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 376/768] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:45:06 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:45:07.237688 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-6e50169f-73ab-4d4d-af88-4a73ca82e81d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:07.238263 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-6e50169f-73ab-4d4d-af88-4a73ca82e81d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:07.244256 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6e50169f-73ab-4d4d-af88-4a73ca82e81d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:07.246716 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6e50169f-73ab-4d4d-af88-4a73ca82e81d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:07.246716 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6e50169f-73ab-4d4d-af88-4a73ca82e81d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:07.246716 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6e50169f-73ab-4d4d-af88-4a73ca82e81d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:07.246716 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6e50169f-73ab-4d4d-af88-4a73ca82e81d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:07.247099 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6e50169f-73ab-4d4d-af88-4a73ca82e81d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:07.386261 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-6e50169f-73ab-4d4d-af88-4a73ca82e81d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:07.393655 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-6e50169f-73ab-4d4d-af88-4a73ca82e81d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1570 microversion: 2.1 time: 0.159832 Aug 24 13:45:07.404229 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 377/769] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:07 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:07.478260 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-7b58771d-1cee-43e7-b1ae-76e020a31bd2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 204 len: 0 microversion: 2.1 time: 0.373005 Aug 24 13:45:07.478940 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 393/770] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:45:07 2022] DELETE /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 13:45:07.493231 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-69f37c4d-1acc-43e2-a81e-0c5cb1c388ef tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:07.493769 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-69f37c4d-1acc-43e2-a81e-0c5cb1c388ef tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:07.500833 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-69f37c4d-1acc-43e2-a81e-0c5cb1c388ef tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:07.501321 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-69f37c4d-1acc-43e2-a81e-0c5cb1c388ef tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:07.501751 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-69f37c4d-1acc-43e2-a81e-0c5cb1c388ef tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:07.502455 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-69f37c4d-1acc-43e2-a81e-0c5cb1c388ef tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:07.502908 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-69f37c4d-1acc-43e2-a81e-0c5cb1c388ef tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:07.503327 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-69f37c4d-1acc-43e2-a81e-0c5cb1c388ef tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:07.652218 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-69f37c4d-1acc-43e2-a81e-0c5cb1c388ef tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:07.663543 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-69f37c4d-1acc-43e2-a81e-0c5cb1c388ef tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1688 microversion: 2.1 time: 0.174323 Aug 24 13:45:07.664147 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 378/771] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:07 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:08.204246 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-47bac9ac-747e-447b-9b31-699de8f8bc2c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:08.204977 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-47bac9ac-747e-447b-9b31-699de8f8bc2c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:08.211504 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-47bac9ac-747e-447b-9b31-699de8f8bc2c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:08.212012 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-47bac9ac-747e-447b-9b31-699de8f8bc2c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:08.212473 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-47bac9ac-747e-447b-9b31-699de8f8bc2c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:08.213159 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-47bac9ac-747e-447b-9b31-699de8f8bc2c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:08.213610 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-47bac9ac-747e-447b-9b31-699de8f8bc2c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:08.214030 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-47bac9ac-747e-447b-9b31-699de8f8bc2c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:08.354117 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-47bac9ac-747e-447b-9b31-699de8f8bc2c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:08.362764 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-47bac9ac-747e-447b-9b31-699de8f8bc2c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:08.364339 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-47bac9ac-747e-447b-9b31-699de8f8bc2c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:08.365522 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-47bac9ac-747e-447b-9b31-699de8f8bc2c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1731 microversion: 2.20 time: 0.166283 Aug 24 13:45:08.366087 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 394/772] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:45:08 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:45:08.415281 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-5e1fb6c4-43ff-455f-a270-8c3e585acde7 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:08.416078 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-5e1fb6c4-43ff-455f-a270-8c3e585acde7 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:08.422945 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5e1fb6c4-43ff-455f-a270-8c3e585acde7 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:08.423441 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5e1fb6c4-43ff-455f-a270-8c3e585acde7 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:08.423882 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5e1fb6c4-43ff-455f-a270-8c3e585acde7 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:08.424626 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5e1fb6c4-43ff-455f-a270-8c3e585acde7 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:08.425177 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5e1fb6c4-43ff-455f-a270-8c3e585acde7 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:08.425608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5e1fb6c4-43ff-455f-a270-8c3e585acde7 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:08.557804 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-0beebd3c-95ee-4cce-a87c-1298005ddc64 req-728521db-ed23-42cb-a25c-222722eed079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac19de18-372a-4cb9-bb59-0cb4b15e80b4", "name": "network-vif-plugged", "status": "completed", "tag": "a11fdd6d-daa9-44f9-b1cc-eeb70dbbd497"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:45:08.569618 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-0beebd3c-95ee-4cce-a87c-1298005ddc64 req-728521db-ed23-42cb-a25c-222722eed079 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:08.572850 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-0beebd3c-95ee-4cce-a87c-1298005ddc64 req-728521db-ed23-42cb-a25c-222722eed079 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:08.572850 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-0beebd3c-95ee-4cce-a87c-1298005ddc64 req-728521db-ed23-42cb-a25c-222722eed079 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:08.583189 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-0beebd3c-95ee-4cce-a87c-1298005ddc64 req-728521db-ed23-42cb-a25c-222722eed079 service nova] Creating event network-vif-plugged:a11fdd6d-daa9-44f9-b1cc-eeb70dbbd497 for instance ac19de18-372a-4cb9-bb59-0cb4b15e80b4 on hv-cinder-77957 Aug 24 13:45:08.588374 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-0beebd3c-95ee-4cce-a87c-1298005ddc64 req-728521db-ed23-42cb-a25c-222722eed079 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034191 Aug 24 13:45:08.588989 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 395/773] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:45:08.597820 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-5e1fb6c4-43ff-455f-a270-8c3e585acde7 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:08.605953 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-5e1fb6c4-43ff-455f-a270-8c3e585acde7 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1570 microversion: 2.1 time: 0.194695 Aug 24 13:45:08.607299 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 379/774] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:08 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1570 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:08.687620 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-14ae1248-d075-4f76-bf43-3023cf98c4c2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:08.688823 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-14ae1248-d075-4f76-bf43-3023cf98c4c2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:08.696619 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-14ae1248-d075-4f76-bf43-3023cf98c4c2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:08.697222 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-14ae1248-d075-4f76-bf43-3023cf98c4c2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:08.697731 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-14ae1248-d075-4f76-bf43-3023cf98c4c2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:08.698668 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-14ae1248-d075-4f76-bf43-3023cf98c4c2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:08.699953 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-14ae1248-d075-4f76-bf43-3023cf98c4c2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:08.699953 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-14ae1248-d075-4f76-bf43-3023cf98c4c2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:08.872727 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-14ae1248-d075-4f76-bf43-3023cf98c4c2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:08.879052 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-14ae1248-d075-4f76-bf43-3023cf98c4c2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1688 microversion: 2.1 time: 0.196647 Aug 24 13:45:08.879635 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 396/775] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:08 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1688 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:09.390390 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-5d10db99-7fa1-49b0-ab4f-755a3af78e11 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:09.391015 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-5d10db99-7fa1-49b0-ab4f-755a3af78e11 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:09.397174 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5d10db99-7fa1-49b0-ab4f-755a3af78e11 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:09.397665 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5d10db99-7fa1-49b0-ab4f-755a3af78e11 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:09.398104 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5d10db99-7fa1-49b0-ab4f-755a3af78e11 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:09.398804 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5d10db99-7fa1-49b0-ab4f-755a3af78e11 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:09.399274 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5d10db99-7fa1-49b0-ab4f-755a3af78e11 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:09.399685 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5d10db99-7fa1-49b0-ab4f-755a3af78e11 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:09.630807 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-7a8798be-a925-4515-8750-42e49c8ec95d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:09.631453 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-7a8798be-a925-4515-8750-42e49c8ec95d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:09.638957 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7a8798be-a925-4515-8750-42e49c8ec95d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:09.639448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7a8798be-a925-4515-8750-42e49c8ec95d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:09.640651 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7a8798be-a925-4515-8750-42e49c8ec95d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:09.641331 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7a8798be-a925-4515-8750-42e49c8ec95d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:09.641792 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7a8798be-a925-4515-8750-42e49c8ec95d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:09.642425 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7a8798be-a925-4515-8750-42e49c8ec95d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:09.796727 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-5d10db99-7fa1-49b0-ab4f-755a3af78e11 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:09.806325 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-5d10db99-7fa1-49b0-ab4f-755a3af78e11 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:09.807845 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-5d10db99-7fa1-49b0-ab4f-755a3af78e11 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:09.809092 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-5d10db99-7fa1-49b0-ab4f-755a3af78e11 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1731 microversion: 2.20 time: 0.423939 Aug 24 13:45:09.809654 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 380/776] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:45:09 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1731 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 13:45:09.882477 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-7a8798be-a925-4515-8750-42e49c8ec95d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:09.886041 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:45:09.895467 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-7a8798be-a925-4515-8750-42e49c8ec95d tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1570 microversion: 2.1 time: 0.264934 Aug 24 13:45:09.895467 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 397/777] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:09 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1570 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:09.901051 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-83e9ae33-efdc-4634-82f3-bf92161f149c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:09.901673 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-83e9ae33-efdc-4634-82f3-bf92161f149c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:09.908562 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-83e9ae33-efdc-4634-82f3-bf92161f149c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:09.909140 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-83e9ae33-efdc-4634-82f3-bf92161f149c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:09.909581 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-83e9ae33-efdc-4634-82f3-bf92161f149c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:09.910287 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-83e9ae33-efdc-4634-82f3-bf92161f149c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:09.910793 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-83e9ae33-efdc-4634-82f3-bf92161f149c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:09.911250 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-83e9ae33-efdc-4634-82f3-bf92161f149c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:10.057454 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-83e9ae33-efdc-4634-82f3-bf92161f149c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:10.065634 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-83e9ae33-efdc-4634-82f3-bf92161f149c tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1688 microversion: 2.1 time: 0.168386 Aug 24 13:45:10.066200 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 381/778] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:09 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:10.603170 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-c4372f9f-af9e-4f8c-84a1-d7ab4cd839c6 req-db11ad29-d15f-4d41-ab70-8cd89da83a33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1118fb04-6744-4b7c-b639-0081073ee53a", "name": "network-vif-unplugged", "status": "completed", "tag": "579a6bec-e4ab-438a-a263-2fafa0fe42bc"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:45:10.613458 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-c4372f9f-af9e-4f8c-84a1-d7ab4cd839c6 req-db11ad29-d15f-4d41-ab70-8cd89da83a33 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:10.613935 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-c4372f9f-af9e-4f8c-84a1-d7ab4cd839c6 req-db11ad29-d15f-4d41-ab70-8cd89da83a33 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:10.614362 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-c4372f9f-af9e-4f8c-84a1-d7ab4cd839c6 req-db11ad29-d15f-4d41-ab70-8cd89da83a33 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:10.626349 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-c4372f9f-af9e-4f8c-84a1-d7ab4cd839c6 req-db11ad29-d15f-4d41-ab70-8cd89da83a33 service nova] Creating event network-vif-unplugged:579a6bec-e4ab-438a-a263-2fafa0fe42bc for instance 1118fb04-6744-4b7c-b639-0081073ee53a on hv-cinder-77957 Aug 24 13:45:10.631931 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-c4372f9f-af9e-4f8c-84a1-d7ab4cd839c6 req-db11ad29-d15f-4d41-ab70-8cd89da83a33 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031595 Aug 24 13:45:10.631931 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 398/779] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:45:10.834201 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-999a6ea3-0ae6-4cc9-ade0-7984c1fce278 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:10.834820 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-999a6ea3-0ae6-4cc9-ade0-7984c1fce278 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:10.841325 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-999a6ea3-0ae6-4cc9-ade0-7984c1fce278 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:10.841888 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-999a6ea3-0ae6-4cc9-ade0-7984c1fce278 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:10.842321 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-999a6ea3-0ae6-4cc9-ade0-7984c1fce278 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:10.843095 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-999a6ea3-0ae6-4cc9-ade0-7984c1fce278 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:10.843543 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-999a6ea3-0ae6-4cc9-ade0-7984c1fce278 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:10.844012 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-999a6ea3-0ae6-4cc9-ade0-7984c1fce278 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:10.920783 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-124f5bfa-a422-492e-b67c-3fd4554f1dad tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:10.921557 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-124f5bfa-a422-492e-b67c-3fd4554f1dad tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:10.929779 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-124f5bfa-a422-492e-b67c-3fd4554f1dad tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:10.929779 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-124f5bfa-a422-492e-b67c-3fd4554f1dad tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:10.930366 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-124f5bfa-a422-492e-b67c-3fd4554f1dad tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:10.931091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-124f5bfa-a422-492e-b67c-3fd4554f1dad tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:10.931549 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-124f5bfa-a422-492e-b67c-3fd4554f1dad tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:10.931973 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-124f5bfa-a422-492e-b67c-3fd4554f1dad tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:11.011875 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-999a6ea3-0ae6-4cc9-ade0-7984c1fce278 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:11.021152 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-999a6ea3-0ae6-4cc9-ade0-7984c1fce278 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:11.022751 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-999a6ea3-0ae6-4cc9-ade0-7984c1fce278 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:11.023920 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-999a6ea3-0ae6-4cc9-ade0-7984c1fce278 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1731 microversion: 2.20 time: 0.194454 Aug 24 13:45:11.024539 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 382/780] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:45:10 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:45:11.091170 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-661bc04a-6210-44e0-968e-8aa166c25b19 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:11.093091 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-661bc04a-6210-44e0-968e-8aa166c25b19 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:11.098725 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-124f5bfa-a422-492e-b67c-3fd4554f1dad tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:11.111161 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-124f5bfa-a422-492e-b67c-3fd4554f1dad tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1570 microversion: 2.1 time: 0.197375 Aug 24 13:45:11.119133 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-661bc04a-6210-44e0-968e-8aa166c25b19 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:11.120028 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-661bc04a-6210-44e0-968e-8aa166c25b19 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:11.120287 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 399/781] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:10 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1570 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:45:11.120947 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-661bc04a-6210-44e0-968e-8aa166c25b19 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:11.122247 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-661bc04a-6210-44e0-968e-8aa166c25b19 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:11.123907 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-661bc04a-6210-44e0-968e-8aa166c25b19 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:11.124724 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-661bc04a-6210-44e0-968e-8aa166c25b19 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:11.401760 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-661bc04a-6210-44e0-968e-8aa166c25b19 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:11.410897 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-661bc04a-6210-44e0-968e-8aa166c25b19 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1688 microversion: 2.1 time: 0.324869 Aug 24 13:45:11.411527 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 383/782] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:11 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1688 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:12.048007 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-22926deb-eddd-48ee-9822-6e6bcb77ca1a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:12.048811 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-22926deb-eddd-48ee-9822-6e6bcb77ca1a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:12.055518 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-22926deb-eddd-48ee-9822-6e6bcb77ca1a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:12.055979 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-22926deb-eddd-48ee-9822-6e6bcb77ca1a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:12.056465 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-22926deb-eddd-48ee-9822-6e6bcb77ca1a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:12.057209 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-22926deb-eddd-48ee-9822-6e6bcb77ca1a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:12.057658 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-22926deb-eddd-48ee-9822-6e6bcb77ca1a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:12.058078 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-22926deb-eddd-48ee-9822-6e6bcb77ca1a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:12.145605 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-176eef2a-8d38-4ef4-8967-f89130f09860 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:12.146231 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-176eef2a-8d38-4ef4-8967-f89130f09860 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:12.152628 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-176eef2a-8d38-4ef4-8967-f89130f09860 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:12.153133 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-176eef2a-8d38-4ef4-8967-f89130f09860 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:12.153578 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-176eef2a-8d38-4ef4-8967-f89130f09860 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:12.154972 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-176eef2a-8d38-4ef4-8967-f89130f09860 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:12.156889 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-176eef2a-8d38-4ef4-8967-f89130f09860 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:12.157329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-176eef2a-8d38-4ef4-8967-f89130f09860 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:12.299213 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-22926deb-eddd-48ee-9822-6e6bcb77ca1a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:12.310316 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-22926deb-eddd-48ee-9822-6e6bcb77ca1a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:12.314628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-22926deb-eddd-48ee-9822-6e6bcb77ca1a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:12.316502 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-22926deb-eddd-48ee-9822-6e6bcb77ca1a tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1731 microversion: 2.20 time: 0.273275 Aug 24 13:45:12.317577 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 400/783] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:45:12 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1731 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:45:12.323175 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-f7862996-1b2f-4ef5-8f6e-dc09dafc7ecc req-a4e517e7-f6e2-4143-8765-661495c864fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1b259b6-2024-4b30-865d-17dadaef5406", "name": "network-vif-deleted", "tag": "7aadab9f-67a3-4721-a287-269890ea0757"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:45:12.337289 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-f7862996-1b2f-4ef5-8f6e-dc09dafc7ecc req-a4e517e7-f6e2-4143-8765-661495c864fc service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:12.337859 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-f7862996-1b2f-4ef5-8f6e-dc09dafc7ecc req-a4e517e7-f6e2-4143-8765-661495c864fc service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:12.338361 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-f7862996-1b2f-4ef5-8f6e-dc09dafc7ecc req-a4e517e7-f6e2-4143-8765-661495c864fc service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:12.356307 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-f7862996-1b2f-4ef5-8f6e-dc09dafc7ecc req-a4e517e7-f6e2-4143-8765-661495c864fc service nova] Creating event network-vif-deleted:7aadab9f-67a3-4721-a287-269890ea0757 for instance c1b259b6-2024-4b30-865d-17dadaef5406 on hv-cinder-77957 Aug 24 13:45:12.364643 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-f7862996-1b2f-4ef5-8f6e-dc09dafc7ecc req-a4e517e7-f6e2-4143-8765-661495c864fc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044323 Aug 24 13:45:12.365782 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 401/784] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:45:12.392853 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-176eef2a-8d38-4ef4-8967-f89130f09860 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:12.395582 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:45:12.402807 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-176eef2a-8d38-4ef4-8967-f89130f09860 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1511 microversion: 2.1 time: 0.260920 Aug 24 13:45:12.404672 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 384/785] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:12 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1511 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:45:12.427442 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-0f288ce4-cce8-4104-b6ff-33a9cd17c39b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:45:12.428486 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-0f288ce4-cce8-4104-b6ff-33a9cd17c39b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:12.436933 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-28820fa1-837b-4638-8e02-628febfa8565 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:12.437547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-28820fa1-837b-4638-8e02-628febfa8565 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:12.441124 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0f288ce4-cce8-4104-b6ff-33a9cd17c39b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:12.441633 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0f288ce4-cce8-4104-b6ff-33a9cd17c39b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:12.442309 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0f288ce4-cce8-4104-b6ff-33a9cd17c39b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:12.443161 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0f288ce4-cce8-4104-b6ff-33a9cd17c39b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:12.444261 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0f288ce4-cce8-4104-b6ff-33a9cd17c39b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:12.444726 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0f288ce4-cce8-4104-b6ff-33a9cd17c39b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:12.446044 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-28820fa1-837b-4638-8e02-628febfa8565 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:12.447245 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-28820fa1-837b-4638-8e02-628febfa8565 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:12.448481 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-28820fa1-837b-4638-8e02-628febfa8565 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:12.451737 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-28820fa1-837b-4638-8e02-628febfa8565 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:12.452704 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-28820fa1-837b-4638-8e02-628febfa8565 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:12.453588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-28820fa1-837b-4638-8e02-628febfa8565 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:12.482848 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-0f288ce4-cce8-4104-b6ff-33a9cd17c39b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=133015) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 13:45:12.528392 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-28820fa1-837b-4638-8e02-628febfa8565 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:12.537621 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-28820fa1-837b-4638-8e02-628febfa8565 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1620 microversion: 2.1 time: 0.104582 Aug 24 13:45:12.538315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 385/786] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:12 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1620 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:12.767098 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-0f288ce4-cce8-4104-b6ff-33a9cd17c39b tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "POST /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a/action" status: 202 len: 0 microversion: 2.1 time: 0.343829 Aug 24 13:45:12.767863 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 402/787] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 13:45:12 2022] POST /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 13:45:12.778239 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-1dbd3d6f-400c-4141-8fc2-3afe0edcc18f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:12.780063 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-1dbd3d6f-400c-4141-8fc2-3afe0edcc18f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:12.789015 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1dbd3d6f-400c-4141-8fc2-3afe0edcc18f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:12.789742 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1dbd3d6f-400c-4141-8fc2-3afe0edcc18f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:12.790258 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1dbd3d6f-400c-4141-8fc2-3afe0edcc18f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:12.791171 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1dbd3d6f-400c-4141-8fc2-3afe0edcc18f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:12.791742 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1dbd3d6f-400c-4141-8fc2-3afe0edcc18f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:12.792378 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1dbd3d6f-400c-4141-8fc2-3afe0edcc18f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:13.040546 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-1dbd3d6f-400c-4141-8fc2-3afe0edcc18f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:13.053234 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-1dbd3d6f-400c-4141-8fc2-3afe0edcc18f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1519 microversion: 2.1 time: 0.280840 Aug 24 13:45:13.053985 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 386/788] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:12 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1519 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:13.341714 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b5ba38c6-df66-4f75-9fb1-cb8e8d78af37 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:13.342570 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b5ba38c6-df66-4f75-9fb1-cb8e8d78af37 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:13.349224 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b5ba38c6-df66-4f75-9fb1-cb8e8d78af37 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:13.349779 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b5ba38c6-df66-4f75-9fb1-cb8e8d78af37 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:13.354030 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b5ba38c6-df66-4f75-9fb1-cb8e8d78af37 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:13.354030 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b5ba38c6-df66-4f75-9fb1-cb8e8d78af37 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:13.354030 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b5ba38c6-df66-4f75-9fb1-cb8e8d78af37 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:13.354030 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b5ba38c6-df66-4f75-9fb1-cb8e8d78af37 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:13.508023 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b5ba38c6-df66-4f75-9fb1-cb8e8d78af37 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:13.519011 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b5ba38c6-df66-4f75-9fb1-cb8e8d78af37 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:13.520930 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b5ba38c6-df66-4f75-9fb1-cb8e8d78af37 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:13.523150 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b5ba38c6-df66-4f75-9fb1-cb8e8d78af37 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1731 microversion: 2.20 time: 0.185650 Aug 24 13:45:13.530438 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 403/789] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:45:13 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:45:13.559987 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-7351a519-f1c7-41e3-ba65-5adce2b047dc tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:13.562009 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-7351a519-f1c7-41e3-ba65-5adce2b047dc tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:13.568128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7351a519-f1c7-41e3-ba65-5adce2b047dc tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:13.568666 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7351a519-f1c7-41e3-ba65-5adce2b047dc tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:13.569105 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7351a519-f1c7-41e3-ba65-5adce2b047dc tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:13.569864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7351a519-f1c7-41e3-ba65-5adce2b047dc tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:13.573043 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7351a519-f1c7-41e3-ba65-5adce2b047dc tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:13.573043 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7351a519-f1c7-41e3-ba65-5adce2b047dc tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:13.607823 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7351a519-f1c7-41e3-ba65-5adce2b047dc tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:13.608248 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7351a519-f1c7-41e3-ba65-5adce2b047dc tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:13.608838 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7351a519-f1c7-41e3-ba65-5adce2b047dc tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:13.609493 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.objects.instance [None req-7351a519-f1c7-41e3-ba65-5adce2b047dc tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lazy-loading 'fault' on Instance uuid c1b259b6-2024-4b30-865d-17dadaef5406 {{(pid=133014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:45:13.657219 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-7351a519-f1c7-41e3-ba65-5adce2b047dc tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:13.665064 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-7351a519-f1c7-41e3-ba65-5adce2b047dc tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 200 len: 1333 microversion: 2.1 time: 0.109697 Aug 24 13:45:13.665656 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 387/790] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:13 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 1333 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:14.075185 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-655d6efb-dbdd-4ff7-9253-bd43fe9fa609 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:14.075802 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-655d6efb-dbdd-4ff7-9253-bd43fe9fa609 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:14.087856 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-655d6efb-dbdd-4ff7-9253-bd43fe9fa609 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:14.091640 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-655d6efb-dbdd-4ff7-9253-bd43fe9fa609 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:14.091640 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-655d6efb-dbdd-4ff7-9253-bd43fe9fa609 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:14.091640 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-655d6efb-dbdd-4ff7-9253-bd43fe9fa609 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:14.091640 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-655d6efb-dbdd-4ff7-9253-bd43fe9fa609 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:14.092021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-655d6efb-dbdd-4ff7-9253-bd43fe9fa609 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:14.239081 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-655d6efb-dbdd-4ff7-9253-bd43fe9fa609 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:14.247716 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-655d6efb-dbdd-4ff7-9253-bd43fe9fa609 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1519 microversion: 2.1 time: 0.176486 Aug 24 13:45:14.248328 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 404/791] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:14 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:14.549098 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-15073946-b32c-47c7-a2ba-f0fde5d51019 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:14.549707 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-15073946-b32c-47c7-a2ba-f0fde5d51019 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:14.557239 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-15073946-b32c-47c7-a2ba-f0fde5d51019 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:14.562050 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-15073946-b32c-47c7-a2ba-f0fde5d51019 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:14.562050 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-15073946-b32c-47c7-a2ba-f0fde5d51019 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:14.562050 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-15073946-b32c-47c7-a2ba-f0fde5d51019 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:14.562050 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-15073946-b32c-47c7-a2ba-f0fde5d51019 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:14.563464 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-15073946-b32c-47c7-a2ba-f0fde5d51019 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:14.715300 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-15073946-b32c-47c7-a2ba-f0fde5d51019 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:14.728688 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-15073946-b32c-47c7-a2ba-f0fde5d51019 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:14.730377 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-15073946-b32c-47c7-a2ba-f0fde5d51019 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:14.731695 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-15073946-b32c-47c7-a2ba-f0fde5d51019 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1731 microversion: 2.20 time: 0.187163 Aug 24 13:45:14.732289 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 388/792] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:45:14 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:45:14.745822 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d53afae8-c77d-4aed-9a84-8907d16ab0c5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:14.747186 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-d53afae8-c77d-4aed-9a84-8907d16ab0c5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: c1b259b6-2024-4b30-865d-17dadaef5406] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:14.755535 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d53afae8-c77d-4aed-9a84-8907d16ab0c5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:14.757404 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d53afae8-c77d-4aed-9a84-8907d16ab0c5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:14.757404 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d53afae8-c77d-4aed-9a84-8907d16ab0c5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:14.757404 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d53afae8-c77d-4aed-9a84-8907d16ab0c5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:14.757702 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d53afae8-c77d-4aed-9a84-8907d16ab0c5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:14.758037 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d53afae8-c77d-4aed-9a84-8907d16ab0c5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:14.773350 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.wsgi [None req-d53afae8-c77d-4aed-9a84-8907d16ab0c5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] HTTP exception thrown: Instance c1b259b6-2024-4b30-865d-17dadaef5406 could not be found. Aug 24 13:45:14.775047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d53afae8-c77d-4aed-9a84-8907d16ab0c5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Request method failure captured: Aug 24 13:45:14.775047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 HTTP/1.1 Aug 24 13:45:14.775047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:45:14.775047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:45:14.775047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:45:14.775047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 0 Aug 24 13:45:14.775047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:45:14.775047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:45:14.775047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:45:14.775047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:45:14.775047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBio-vt113GyIGAINLSzOWx94ASYzerXaZEv5YREo1TToDpvzKyjcRowpvDgdJaKCc7yo4wyulaPEgIjpHjojWeA6p7mHKzAe5aa4pnmTJ73FsHansramwsQRGoDLdIydz44BXnhPycna7G2wYedVilx-YfOCQ3CHOnMCEUjDFP26dAs Aug 24 13:45:14.775047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:45:14.775047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:45:14.775047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:45:14.775047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:45:14.775047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:45:14.775047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:45:14.775047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: 127e5da55b164ce68568c153fee58baf Aug 24 13:45:14.775047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1606015574 Aug 24 13:45:14.775047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:45:14.775047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:45:14.776710 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/127e5da55b164ce68568c153fee58baf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/127e5da55b164ce68568c153fee58baf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_127e5da55b164ce68568c153fee58baf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/127e5da55b164ce68568c153fee58baf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:45:14.776710 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1606015574 Aug 24 13:45:14.776710 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: 127e5da55b164ce68568c153fee58baf Aug 24 13:45:14.776710 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1606015574 Aug 24 13:45:14.776710 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-ServerRescueNegativeTestJSON-1606015574-project Aug 24 13:45:14.776710 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:45:14.776710 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:45:14.776710 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: adb792e7246d42dface4aa52899a0ffc Aug 24 13:45:14.776710 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1606015574-project Aug 24 13:45:14.776710 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: > Aug 24 13:45:14.776710 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Instance c1b259b6-2024-4b30-865d-17dadaef5406 could not be found. Aug 24 13:45:14.776710 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'id': 'c1b259b6-2024-4b30-865d-17dadaef5406'} Aug 24 13:45:14.777660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:45:14.777660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:14.777660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:45:14.777660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:45:14.777660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:45:14.777660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:45:14.777660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:45:14.777660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:45:14.777660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:45:14.777660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:45:14.777660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1b259b6-2024-4b30-865d-17dadaef5406 could not be found. Aug 24 13:45:14.777660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:14.777660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:14.777660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:14.777660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:14.777660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:14.777660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:14.777660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:45:14.777660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:45:14.777660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:45:14.779172 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:45:14.779172 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:45:14.779172 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:45:14.779172 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:45:14.779172 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:45:14.779172 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:45:14.779172 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:45:14.779172 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1b259b6-2024-4b30-865d-17dadaef5406 could not be found. Aug 24 13:45:14.779172 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:14.779172 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:14.779172 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:14.779172 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:14.779172 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:14.779172 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:14.779172 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:45:14.779172 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:45:14.779172 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1b259b6-2024-4b30-865d-17dadaef5406 could not be found. Aug 24 13:45:14.779172 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:14.780531 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d53afae8-c77d-4aed-9a84-8907d16ab0c5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Returning 404 to user: Instance c1b259b6-2024-4b30-865d-17dadaef5406 could not be found. {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:45:14.780531 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-d53afae8-c77d-4aed-9a84-8907d16ab0c5 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406" status: 404 len: 111 microversion: 2.1 time: 0.094605 Aug 24 13:45:14.780531 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 405/793] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:14 2022] GET /compute/v2.1/servers/c1b259b6-2024-4b30-865d-17dadaef5406 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 13:45:14.790417 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-adcdd053-0e14-4236-8569-300d4f201121 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '.version_select at 0x7f96c219c430>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:14.932873 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-adcdd053-0e14-4236-8569-300d4f201121 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1585981523" status: 202 len: 0 microversion: 2.1 time: 0.145448 Aug 24 13:45:14.932873 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 389/794] 10.222.0.73 () {58 vars in 1221 bytes} [Wed Aug 24 13:45:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1585981523 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:45:15.131637 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-3a947b3b-3e6a-4b5e-a3c5-197411a61084 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:15.132147 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-3a947b3b-3e6a-4b5e-a3c5-197411a61084 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:15.135521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:45:15.138898 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3a947b3b-3e6a-4b5e-a3c5-197411a61084 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:15.139374 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3a947b3b-3e6a-4b5e-a3c5-197411a61084 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:15.139798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3a947b3b-3e6a-4b5e-a3c5-197411a61084 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:15.141149 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3a947b3b-3e6a-4b5e-a3c5-197411a61084 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:15.141604 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3a947b3b-3e6a-4b5e-a3c5-197411a61084 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:15.142021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3a947b3b-3e6a-4b5e-a3c5-197411a61084 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:15.260067 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.objects.instance [None req-3a947b3b-3e6a-4b5e-a3c5-197411a61084 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lazy-loading 'services' on Instance uuid c70a39ae-b902-41c8-a735-c48983629b25 {{(pid=133015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:45:15.270074 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-feb9fdf4-66a8-4073-9d70-760408575dbd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:15.271148 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-feb9fdf4-66a8-4073-9d70-760408575dbd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:15.278047 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-feb9fdf4-66a8-4073-9d70-760408575dbd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:15.278788 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-feb9fdf4-66a8-4073-9d70-760408575dbd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:15.279400 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-feb9fdf4-66a8-4073-9d70-760408575dbd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:15.280297 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-feb9fdf4-66a8-4073-9d70-760408575dbd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:15.280903 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-feb9fdf4-66a8-4073-9d70-760408575dbd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:15.281505 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-feb9fdf4-66a8-4073-9d70-760408575dbd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:15.438234 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-feb9fdf4-66a8-4073-9d70-760408575dbd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:15.446645 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-feb9fdf4-66a8-4073-9d70-760408575dbd tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1521 microversion: 2.1 time: 0.181435 Aug 24 13:45:15.450001 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 390/795] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:15 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:45:15.486902 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-3a947b3b-3e6a-4b5e-a3c5-197411a61084 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25/os-volume_attachments/12cf4c11-348d-4d20-9160-293b6a46c915" status: 202 len: 0 microversion: 2.1 time: 0.359016 Aug 24 13:45:15.487594 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 406/796] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 13:45:15 2022] DELETE /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25/os-volume_attachments/12cf4c11-348d-4d20-9160-293b6a46c915 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:45:15.496902 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e922a131-9608-4fb7-aa3e-eab37c6901c2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:15.499473 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-e922a131-9608-4fb7-aa3e-eab37c6901c2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:15.506426 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e922a131-9608-4fb7-aa3e-eab37c6901c2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:15.507171 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e922a131-9608-4fb7-aa3e-eab37c6901c2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:15.507671 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e922a131-9608-4fb7-aa3e-eab37c6901c2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:15.508486 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e922a131-9608-4fb7-aa3e-eab37c6901c2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:15.509136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e922a131-9608-4fb7-aa3e-eab37c6901c2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:15.509624 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e922a131-9608-4fb7-aa3e-eab37c6901c2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:15.540213 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-e922a131-9608-4fb7-aa3e-eab37c6901c2 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047607 Aug 24 13:45:15.541067 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 391/797] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:45:15 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:45:15.758255 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d260ebee-c3e6-4730-a213-4595fd86bc6b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:15.758966 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-d260ebee-c3e6-4730-a213-4595fd86bc6b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:15.765616 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d260ebee-c3e6-4730-a213-4595fd86bc6b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:15.766554 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d260ebee-c3e6-4730-a213-4595fd86bc6b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:15.767022 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d260ebee-c3e6-4730-a213-4595fd86bc6b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:15.767715 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d260ebee-c3e6-4730-a213-4595fd86bc6b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:15.768228 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d260ebee-c3e6-4730-a213-4595fd86bc6b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:15.768666 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d260ebee-c3e6-4730-a213-4595fd86bc6b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:15.924796 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d260ebee-c3e6-4730-a213-4595fd86bc6b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:15.933524 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d260ebee-c3e6-4730-a213-4595fd86bc6b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:15.935018 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d260ebee-c3e6-4730-a213-4595fd86bc6b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:15.936172 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-d260ebee-c3e6-4730-a213-4595fd86bc6b tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1718 microversion: 2.20 time: 0.183449 Aug 24 13:45:15.936756 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 407/798] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:45:15 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1718 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:45:16.469929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-642da3af-032f-48d6-8e97-4d32c8774502 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:16.470565 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-642da3af-032f-48d6-8e97-4d32c8774502 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:16.473045 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:45:16.478490 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-642da3af-032f-48d6-8e97-4d32c8774502 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:16.478983 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-642da3af-032f-48d6-8e97-4d32c8774502 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:16.479422 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-642da3af-032f-48d6-8e97-4d32c8774502 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:16.480131 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-642da3af-032f-48d6-8e97-4d32c8774502 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:16.480615 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-642da3af-032f-48d6-8e97-4d32c8774502 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:16.481045 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-642da3af-032f-48d6-8e97-4d32c8774502 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:16.555009 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-80833d57-c295-4f39-865d-02ab676d3281 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:16.557597 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-80833d57-c295-4f39-865d-02ab676d3281 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:16.566579 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-80833d57-c295-4f39-865d-02ab676d3281 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:16.567629 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-80833d57-c295-4f39-865d-02ab676d3281 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:16.567629 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-80833d57-c295-4f39-865d-02ab676d3281 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:16.573688 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-80833d57-c295-4f39-865d-02ab676d3281 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:16.574249 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-80833d57-c295-4f39-865d-02ab676d3281 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:16.574686 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-80833d57-c295-4f39-865d-02ab676d3281 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:16.611813 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-80833d57-c295-4f39-865d-02ab676d3281 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060891 Aug 24 13:45:16.612322 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 408/799] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:45:16 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:45:16.636153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-642da3af-032f-48d6-8e97-4d32c8774502 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:16.645527 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-642da3af-032f-48d6-8e97-4d32c8774502 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1521 microversion: 2.1 time: 0.179887 Aug 24 13:45:16.650282 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 392/800] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:16 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:17.623887 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-9bbcae1b-05e4-42a3-a1ff-243bcadc075c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:17.627060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-9bbcae1b-05e4-42a3-a1ff-243bcadc075c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:17.633662 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9bbcae1b-05e4-42a3-a1ff-243bcadc075c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:17.634225 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9bbcae1b-05e4-42a3-a1ff-243bcadc075c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:17.634652 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9bbcae1b-05e4-42a3-a1ff-243bcadc075c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:17.635341 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9bbcae1b-05e4-42a3-a1ff-243bcadc075c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:17.635795 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9bbcae1b-05e4-42a3-a1ff-243bcadc075c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:17.636247 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9bbcae1b-05e4-42a3-a1ff-243bcadc075c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:17.668824 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-9bbcae1b-05e4-42a3-a1ff-243bcadc075c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049270 Aug 24 13:45:17.669572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 409/801] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:45:17 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 13:45:17.675231 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-eb540b61-bbd4-4658-8cca-ba606a30e78c tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:17.676482 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-eb540b61-bbd4-4658-8cca-ba606a30e78c tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:17.684975 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eb540b61-bbd4-4658-8cca-ba606a30e78c tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:17.685610 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eb540b61-bbd4-4658-8cca-ba606a30e78c tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:17.686050 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eb540b61-bbd4-4658-8cca-ba606a30e78c tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:17.687044 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eb540b61-bbd4-4658-8cca-ba606a30e78c tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:17.688978 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eb540b61-bbd4-4658-8cca-ba606a30e78c tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:17.689600 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eb540b61-bbd4-4658-8cca-ba606a30e78c tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:17.743850 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-0962ede7-bcfc-4579-ac70-558e643b860b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:17.744685 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-0962ede7-bcfc-4579-ac70-558e643b860b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:17.751330 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0962ede7-bcfc-4579-ac70-558e643b860b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:17.752301 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0962ede7-bcfc-4579-ac70-558e643b860b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:17.752739 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0962ede7-bcfc-4579-ac70-558e643b860b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:17.753452 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0962ede7-bcfc-4579-ac70-558e643b860b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:17.754060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0962ede7-bcfc-4579-ac70-558e643b860b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:17.755230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0962ede7-bcfc-4579-ac70-558e643b860b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:17.784827 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-0962ede7-bcfc-4579-ac70-558e643b860b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Going to try to terminate instance {{(pid=133015) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 13:45:17.902083 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-eb540b61-bbd4-4658-8cca-ba606a30e78c tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:17.911105 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-eb540b61-bbd4-4658-8cca-ba606a30e78c tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1577 microversion: 2.1 time: 0.241096 Aug 24 13:45:17.911695 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 393/802] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:17 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1577 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:18.068756 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-0962ede7-bcfc-4579-ac70-558e643b860b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25" status: 204 len: 0 microversion: 2.1 time: 0.328383 Aug 24 13:45:18.069451 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 410/803] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:45:17 2022] DELETE /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 13:45:18.079048 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-47d704c4-1cf7-40a7-a2d1-43d6e7364095 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:18.079686 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-47d704c4-1cf7-40a7-a2d1-43d6e7364095 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:18.085808 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-47d704c4-1cf7-40a7-a2d1-43d6e7364095 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:18.086303 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-47d704c4-1cf7-40a7-a2d1-43d6e7364095 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:18.086746 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-47d704c4-1cf7-40a7-a2d1-43d6e7364095 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:18.087446 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-47d704c4-1cf7-40a7-a2d1-43d6e7364095 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:18.087909 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-47d704c4-1cf7-40a7-a2d1-43d6e7364095 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:18.088372 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-47d704c4-1cf7-40a7-a2d1-43d6e7364095 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:18.231541 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-47d704c4-1cf7-40a7-a2d1-43d6e7364095 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:18.241598 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-47d704c4-1cf7-40a7-a2d1-43d6e7364095 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25" status: 200 len: 1682 microversion: 2.1 time: 0.166916 Aug 24 13:45:18.241882 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 394/804] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:18 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:18.508734 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-1dac5718-991b-45a3-a1b8-c1432eec2e34 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:18.509395 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-1dac5718-991b-45a3-a1b8-c1432eec2e34 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:18.515961 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1dac5718-991b-45a3-a1b8-c1432eec2e34 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:18.516538 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1dac5718-991b-45a3-a1b8-c1432eec2e34 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:18.517056 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1dac5718-991b-45a3-a1b8-c1432eec2e34 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:18.517839 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1dac5718-991b-45a3-a1b8-c1432eec2e34 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:18.518358 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1dac5718-991b-45a3-a1b8-c1432eec2e34 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:18.518777 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1dac5718-991b-45a3-a1b8-c1432eec2e34 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:18.545519 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-1dac5718-991b-45a3-a1b8-c1432eec2e34 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Going to try to terminate instance {{(pid=133015) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 13:45:18.693039 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:45:18.932788 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-3b3c2a9b-d8a3-4f18-9dd0-f47edaaf1471 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:18.933398 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-3b3c2a9b-d8a3-4f18-9dd0-f47edaaf1471 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:18.940455 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3b3c2a9b-d8a3-4f18-9dd0-f47edaaf1471 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:18.940972 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3b3c2a9b-d8a3-4f18-9dd0-f47edaaf1471 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:18.941406 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3b3c2a9b-d8a3-4f18-9dd0-f47edaaf1471 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:18.942112 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3b3c2a9b-d8a3-4f18-9dd0-f47edaaf1471 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:18.942560 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3b3c2a9b-d8a3-4f18-9dd0-f47edaaf1471 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:18.942979 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3b3c2a9b-d8a3-4f18-9dd0-f47edaaf1471 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:18.955383 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-1dac5718-991b-45a3-a1b8-c1432eec2e34 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "DELETE /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 204 len: 0 microversion: 2.1 time: 0.450813 Aug 24 13:45:18.959173 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 411/805] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:45:18 2022] DELETE /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:45:18.964797 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a952911d-0817-492b-842d-ba4916535c90 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:18.965500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-a952911d-0817-492b-842d-ba4916535c90 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:18.973018 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a952911d-0817-492b-842d-ba4916535c90 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:18.973506 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a952911d-0817-492b-842d-ba4916535c90 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:18.973941 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a952911d-0817-492b-842d-ba4916535c90 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:18.974635 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a952911d-0817-492b-842d-ba4916535c90 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:18.975110 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a952911d-0817-492b-842d-ba4916535c90 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:18.975501 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a952911d-0817-492b-842d-ba4916535c90 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:19.146829 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3b3c2a9b-d8a3-4f18-9dd0-f47edaaf1471 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:19.155216 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-3b3c2a9b-d8a3-4f18-9dd0-f47edaaf1471 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1577 microversion: 2.1 time: 0.226335 Aug 24 13:45:19.155802 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 395/806] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:18 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1577 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:45:19.177624 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-a952911d-0817-492b-842d-ba4916535c90 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:19.185630 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a952911d-0817-492b-842d-ba4916535c90 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1508 microversion: 2.1 time: 0.224975 Aug 24 13:45:19.186231 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 412/807] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:18 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1508 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:19.263112 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a2cfa86b-1245-4d64-ab8c-22edb5708c5c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:19.263775 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a2cfa86b-1245-4d64-ab8c-22edb5708c5c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:19.270597 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a2cfa86b-1245-4d64-ab8c-22edb5708c5c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:19.271080 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a2cfa86b-1245-4d64-ab8c-22edb5708c5c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:19.271508 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a2cfa86b-1245-4d64-ab8c-22edb5708c5c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:19.272222 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a2cfa86b-1245-4d64-ab8c-22edb5708c5c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:19.272674 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a2cfa86b-1245-4d64-ab8c-22edb5708c5c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:19.273094 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a2cfa86b-1245-4d64-ab8c-22edb5708c5c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:19.413835 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a2cfa86b-1245-4d64-ab8c-22edb5708c5c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:19.422489 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a2cfa86b-1245-4d64-ab8c-22edb5708c5c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25" status: 200 len: 1682 microversion: 2.1 time: 0.162555 Aug 24 13:45:19.423451 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 396/808] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:19 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:20.182452 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-03cf93f5-a24c-4efc-abb0-499dce4942fb tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:20.183088 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-03cf93f5-a24c-4efc-abb0-499dce4942fb tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:20.190030 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-03cf93f5-a24c-4efc-abb0-499dce4942fb tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:20.190523 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-03cf93f5-a24c-4efc-abb0-499dce4942fb tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:20.190958 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-03cf93f5-a24c-4efc-abb0-499dce4942fb tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:20.191660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-03cf93f5-a24c-4efc-abb0-499dce4942fb tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:20.192113 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-03cf93f5-a24c-4efc-abb0-499dce4942fb tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:20.192575 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-03cf93f5-a24c-4efc-abb0-499dce4942fb tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:20.207861 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-06c8ac25-696d-4455-9af5-711aaf71d339 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:20.208672 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-06c8ac25-696d-4455-9af5-711aaf71d339 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:20.215183 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-06c8ac25-696d-4455-9af5-711aaf71d339 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:20.215673 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-06c8ac25-696d-4455-9af5-711aaf71d339 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:20.216111 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-06c8ac25-696d-4455-9af5-711aaf71d339 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:20.216875 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-06c8ac25-696d-4455-9af5-711aaf71d339 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:20.217413 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-06c8ac25-696d-4455-9af5-711aaf71d339 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:20.217844 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-06c8ac25-696d-4455-9af5-711aaf71d339 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:20.402606 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-03cf93f5-a24c-4efc-abb0-499dce4942fb tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:20.411267 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-03cf93f5-a24c-4efc-abb0-499dce4942fb tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1577 microversion: 2.1 time: 0.232584 Aug 24 13:45:20.411867 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 413/809] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:20 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1577 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:20.416045 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-06c8ac25-696d-4455-9af5-711aaf71d339 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:20.425234 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-06c8ac25-696d-4455-9af5-711aaf71d339 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1508 microversion: 2.1 time: 0.222081 Aug 24 13:45:20.425818 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 397/810] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:20 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1508 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:45:20.447308 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-cd5cff56-56d9-48ea-aae9-8faa6a4eece8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:20.447834 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-cd5cff56-56d9-48ea-aae9-8faa6a4eece8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:20.453917 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cd5cff56-56d9-48ea-aae9-8faa6a4eece8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:20.454388 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cd5cff56-56d9-48ea-aae9-8faa6a4eece8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:20.454816 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cd5cff56-56d9-48ea-aae9-8faa6a4eece8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:20.455791 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cd5cff56-56d9-48ea-aae9-8faa6a4eece8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:20.455977 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cd5cff56-56d9-48ea-aae9-8faa6a4eece8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:20.456429 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cd5cff56-56d9-48ea-aae9-8faa6a4eece8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:20.587762 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-cd5cff56-56d9-48ea-aae9-8faa6a4eece8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:20.596326 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-cd5cff56-56d9-48ea-aae9-8faa6a4eece8 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25" status: 200 len: 1682 microversion: 2.1 time: 0.152896 Aug 24 13:45:20.596900 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 414/811] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:20 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:21.433643 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-48951502-a216-49f3-9081-3a6667c36d24 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:21.434254 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-48951502-a216-49f3-9081-3a6667c36d24 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:21.441891 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-48951502-a216-49f3-9081-3a6667c36d24 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:21.442376 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-48951502-a216-49f3-9081-3a6667c36d24 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:21.442810 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-48951502-a216-49f3-9081-3a6667c36d24 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:21.443574 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-48951502-a216-49f3-9081-3a6667c36d24 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:21.444030 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-48951502-a216-49f3-9081-3a6667c36d24 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:21.444485 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-48951502-a216-49f3-9081-3a6667c36d24 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:21.446446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d666060d-457e-40c7-9086-78a1ac7214f0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:21.447152 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-d666060d-457e-40c7-9086-78a1ac7214f0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:21.454245 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d666060d-457e-40c7-9086-78a1ac7214f0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:21.454727 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d666060d-457e-40c7-9086-78a1ac7214f0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:21.455158 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d666060d-457e-40c7-9086-78a1ac7214f0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:21.455848 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d666060d-457e-40c7-9086-78a1ac7214f0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:21.456328 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d666060d-457e-40c7-9086-78a1ac7214f0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:21.456754 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d666060d-457e-40c7-9086-78a1ac7214f0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:21.657554 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-48951502-a216-49f3-9081-3a6667c36d24 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:21.661406 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d666060d-457e-40c7-9086-78a1ac7214f0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:21.665575 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-48951502-a216-49f3-9081-3a6667c36d24 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1577 microversion: 2.1 time: 0.235816 Aug 24 13:45:21.666153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 398/812] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:21 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1577 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:21.669333 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-d666060d-457e-40c7-9086-78a1ac7214f0 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1508 microversion: 2.1 time: 0.226889 Aug 24 13:45:21.670032 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 415/813] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:21 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1508 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:45:21.670580 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-28971ca5-151e-4662-a4e9-9c7949d544a6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:21.671181 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-28971ca5-151e-4662-a4e9-9c7949d544a6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:21.677679 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-28971ca5-151e-4662-a4e9-9c7949d544a6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:21.678162 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-28971ca5-151e-4662-a4e9-9c7949d544a6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:21.678591 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-28971ca5-151e-4662-a4e9-9c7949d544a6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:21.679276 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-28971ca5-151e-4662-a4e9-9c7949d544a6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:21.679760 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-28971ca5-151e-4662-a4e9-9c7949d544a6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:21.680204 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-28971ca5-151e-4662-a4e9-9c7949d544a6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:21.817510 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-28971ca5-151e-4662-a4e9-9c7949d544a6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:21.825225 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-28971ca5-151e-4662-a4e9-9c7949d544a6 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25" status: 200 len: 1682 microversion: 2.1 time: 0.158139 Aug 24 13:45:21.825821 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 399/814] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:21 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:22.464716 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-92a60419-9662-4e75-97d9-2d48e473ad64 req-7cbfa263-8e11-4ce8-a8b0-f28fa1843375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c70a39ae-b902-41c8-a735-c48983629b25", "name": "network-vif-unplugged", "status": "completed", "tag": "a4155bd9-091b-424f-94b6-1d07874966f0"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:45:22.480599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-92a60419-9662-4e75-97d9-2d48e473ad64 req-7cbfa263-8e11-4ce8-a8b0-f28fa1843375 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:22.480599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-92a60419-9662-4e75-97d9-2d48e473ad64 req-7cbfa263-8e11-4ce8-a8b0-f28fa1843375 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:22.480599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-92a60419-9662-4e75-97d9-2d48e473ad64 req-7cbfa263-8e11-4ce8-a8b0-f28fa1843375 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:22.494168 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-92a60419-9662-4e75-97d9-2d48e473ad64 req-7cbfa263-8e11-4ce8-a8b0-f28fa1843375 service nova] Creating event network-vif-unplugged:a4155bd9-091b-424f-94b6-1d07874966f0 for instance c70a39ae-b902-41c8-a735-c48983629b25 on hv-cinder-77957 Aug 24 13:45:22.499540 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-92a60419-9662-4e75-97d9-2d48e473ad64 req-7cbfa263-8e11-4ce8-a8b0-f28fa1843375 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038490 Aug 24 13:45:22.500237 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 416/815] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:45:22.690455 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-8f745c05-5251-4e34-b596-2c64e8ab0142 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:22.691713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-8f745c05-5251-4e34-b596-2c64e8ab0142 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:22.692109 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-0e071db6-d763-47a0-ab92-0275b1a33eaa tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:22.693129 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-0e071db6-d763-47a0-ab92-0275b1a33eaa tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:22.698374 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8f745c05-5251-4e34-b596-2c64e8ab0142 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:22.698865 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8f745c05-5251-4e34-b596-2c64e8ab0142 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:22.699299 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8f745c05-5251-4e34-b596-2c64e8ab0142 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:22.699440 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0e071db6-d763-47a0-ab92-0275b1a33eaa tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:22.699994 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0e071db6-d763-47a0-ab92-0275b1a33eaa tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:22.700370 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8f745c05-5251-4e34-b596-2c64e8ab0142 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:22.700656 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0e071db6-d763-47a0-ab92-0275b1a33eaa tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:22.700824 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8f745c05-5251-4e34-b596-2c64e8ab0142 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:22.701244 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8f745c05-5251-4e34-b596-2c64e8ab0142 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:22.701598 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0e071db6-d763-47a0-ab92-0275b1a33eaa tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:22.702130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0e071db6-d763-47a0-ab92-0275b1a33eaa tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:22.702667 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0e071db6-d763-47a0-ab92-0275b1a33eaa tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:23.131694 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-8f745c05-5251-4e34-b596-2c64e8ab0142 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:23.142142 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-8f745c05-5251-4e34-b596-2c64e8ab0142 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1577 microversion: 2.1 time: 0.455448 Aug 24 13:45:23.142496 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-0e071db6-d763-47a0-ab92-0275b1a33eaa tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:23.143589 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 400/816] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:22 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1577 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:23.151663 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-0e071db6-d763-47a0-ab92-0275b1a33eaa tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1508 microversion: 2.1 time: 0.465032 Aug 24 13:45:23.151944 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-da204647-1e70-4e78-a580-98bf4f53b6c9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:23.152945 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-da204647-1e70-4e78-a580-98bf4f53b6c9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:23.163840 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 417/817] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:22 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1508 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:45:23.167820 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-da204647-1e70-4e78-a580-98bf4f53b6c9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:23.169354 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-da204647-1e70-4e78-a580-98bf4f53b6c9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:23.169696 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-da204647-1e70-4e78-a580-98bf4f53b6c9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:23.170946 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-da204647-1e70-4e78-a580-98bf4f53b6c9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:23.171821 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-da204647-1e70-4e78-a580-98bf4f53b6c9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:23.172335 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-da204647-1e70-4e78-a580-98bf4f53b6c9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:23.482590 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-da204647-1e70-4e78-a580-98bf4f53b6c9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:23.493695 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-da204647-1e70-4e78-a580-98bf4f53b6c9 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25" status: 200 len: 1682 microversion: 2.1 time: 0.348631 Aug 24 13:45:23.494378 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 401/818] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:23 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 => generated 1682 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:23.920571 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-bc14856d-51a5-4982-8e6a-8e5b88ee9e33 req-ef8fd9f3-e536-41d7-bc29-03ab4f877b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe90b5c-a710-43ee-b3a8-773a37849056", "name": "network-vif-deleted", "tag": "19cbe24e-f4f7-4309-aa0c-30c3342c1d7c"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:45:23.931098 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-bc14856d-51a5-4982-8e6a-8e5b88ee9e33 req-ef8fd9f3-e536-41d7-bc29-03ab4f877b5b service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:23.931580 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-bc14856d-51a5-4982-8e6a-8e5b88ee9e33 req-ef8fd9f3-e536-41d7-bc29-03ab4f877b5b service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:23.932006 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-bc14856d-51a5-4982-8e6a-8e5b88ee9e33 req-ef8fd9f3-e536-41d7-bc29-03ab4f877b5b service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:23.945697 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-bc14856d-51a5-4982-8e6a-8e5b88ee9e33 req-ef8fd9f3-e536-41d7-bc29-03ab4f877b5b service nova] Creating event network-vif-deleted:19cbe24e-f4f7-4309-aa0c-30c3342c1d7c for instance fbe90b5c-a710-43ee-b3a8-773a37849056 on hv-cinder-77957 Aug 24 13:45:23.950675 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-bc14856d-51a5-4982-8e6a-8e5b88ee9e33 req-ef8fd9f3-e536-41d7-bc29-03ab4f877b5b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033726 Aug 24 13:45:23.951280 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 418/819] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:45:24.168426 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-b15b0f74-b1f1-4c31-b071-492296c46296 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:24.169850 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-b15b0f74-b1f1-4c31-b071-492296c46296 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:24.175307 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-53fd1f0e-29c7-46f8-b92d-f26081ae9738 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:24.178324 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-53fd1f0e-29c7-46f8-b92d-f26081ae9738 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:24.179518 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b15b0f74-b1f1-4c31-b071-492296c46296 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:24.181638 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b15b0f74-b1f1-4c31-b071-492296c46296 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:24.182247 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b15b0f74-b1f1-4c31-b071-492296c46296 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:24.183249 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b15b0f74-b1f1-4c31-b071-492296c46296 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:24.183936 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b15b0f74-b1f1-4c31-b071-492296c46296 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:24.184616 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b15b0f74-b1f1-4c31-b071-492296c46296 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:24.192060 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=100 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:45:24.192861 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-53fd1f0e-29c7-46f8-b92d-f26081ae9738 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:24.193620 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-53fd1f0e-29c7-46f8-b92d-f26081ae9738 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:24.194260 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-53fd1f0e-29c7-46f8-b92d-f26081ae9738 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:24.195180 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-53fd1f0e-29c7-46f8-b92d-f26081ae9738 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:24.195898 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-53fd1f0e-29c7-46f8-b92d-f26081ae9738 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:24.196554 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-53fd1f0e-29c7-46f8-b92d-f26081ae9738 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:24.334802 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-53fd1f0e-29c7-46f8-b92d-f26081ae9738 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:24.344334 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-53fd1f0e-29c7-46f8-b92d-f26081ae9738 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1466 microversion: 2.1 time: 0.174264 Aug 24 13:45:24.345761 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 419/820] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:24 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1466 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:24.464958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-b15b0f74-b1f1-4c31-b071-492296c46296 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:24.475491 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-b15b0f74-b1f1-4c31-b071-492296c46296 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1577 microversion: 2.1 time: 0.310778 Aug 24 13:45:24.477023 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 402/821] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:24 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1577 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:24.520589 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-2a67dad7-1814-48d8-8d9f-eb4c2d09253f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:24.521067 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-2a67dad7-1814-48d8-8d9f-eb4c2d09253f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:24.527463 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2a67dad7-1814-48d8-8d9f-eb4c2d09253f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:24.528103 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2a67dad7-1814-48d8-8d9f-eb4c2d09253f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:24.528577 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2a67dad7-1814-48d8-8d9f-eb4c2d09253f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:24.529817 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2a67dad7-1814-48d8-8d9f-eb4c2d09253f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:24.530293 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2a67dad7-1814-48d8-8d9f-eb4c2d09253f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:24.530718 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2a67dad7-1814-48d8-8d9f-eb4c2d09253f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:24.611601 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2a67dad7-1814-48d8-8d9f-eb4c2d09253f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:24.622989 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-2a67dad7-1814-48d8-8d9f-eb4c2d09253f tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25" status: 200 len: 1326 microversion: 2.1 time: 0.105830 Aug 24 13:45:24.636952 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 420/822] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:24 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 => generated 1326 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:25.370219 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-bd67fe58-d113-4e93-b1c7-ebc6d2c5b2d3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:25.370826 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-bd67fe58-d113-4e93-b1c7-ebc6d2c5b2d3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:25.377419 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd67fe58-d113-4e93-b1c7-ebc6d2c5b2d3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:25.377904 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd67fe58-d113-4e93-b1c7-ebc6d2c5b2d3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:25.378338 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd67fe58-d113-4e93-b1c7-ebc6d2c5b2d3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:25.379037 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd67fe58-d113-4e93-b1c7-ebc6d2c5b2d3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:25.379659 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd67fe58-d113-4e93-b1c7-ebc6d2c5b2d3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:25.380099 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd67fe58-d113-4e93-b1c7-ebc6d2c5b2d3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:25.415844 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd67fe58-d113-4e93-b1c7-ebc6d2c5b2d3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:25.416610 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd67fe58-d113-4e93-b1c7-ebc6d2c5b2d3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:25.417228 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd67fe58-d113-4e93-b1c7-ebc6d2c5b2d3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:25.420386 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.objects.instance [None req-bd67fe58-d113-4e93-b1c7-ebc6d2c5b2d3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lazy-loading 'fault' on Instance uuid fbe90b5c-a710-43ee-b3a8-773a37849056 {{(pid=133014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:45:25.462342 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-bd67fe58-d113-4e93-b1c7-ebc6d2c5b2d3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:25.469436 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-bd67fe58-d113-4e93-b1c7-ebc6d2c5b2d3 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 200 len: 1312 microversion: 2.1 time: 0.103188 Aug 24 13:45:25.470534 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 403/823] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:25 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:25.498004 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-8dc78c67-e7fa-4053-9ccc-f6cd83c1c0f3 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:25.498610 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-8dc78c67-e7fa-4053-9ccc-f6cd83c1c0f3 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:25.505047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8dc78c67-e7fa-4053-9ccc-f6cd83c1c0f3 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:25.505529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8dc78c67-e7fa-4053-9ccc-f6cd83c1c0f3 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:25.505962 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8dc78c67-e7fa-4053-9ccc-f6cd83c1c0f3 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:25.506696 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8dc78c67-e7fa-4053-9ccc-f6cd83c1c0f3 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:25.507151 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8dc78c67-e7fa-4053-9ccc-f6cd83c1c0f3 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:25.507566 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8dc78c67-e7fa-4053-9ccc-f6cd83c1c0f3 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:25.643918 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-8dc78c67-e7fa-4053-9ccc-f6cd83c1c0f3 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:25.647762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-97801215-3ee1-4b01-b0d9-6a67c1a0e9c5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:25.648414 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-97801215-3ee1-4b01-b0d9-6a67c1a0e9c5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:25.651931 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-8dc78c67-e7fa-4053-9ccc-f6cd83c1c0f3 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1577 microversion: 2.1 time: 0.157775 Aug 24 13:45:25.652567 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 421/824] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:25 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:25.654287 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97801215-3ee1-4b01-b0d9-6a67c1a0e9c5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:25.654781 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97801215-3ee1-4b01-b0d9-6a67c1a0e9c5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:25.655225 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97801215-3ee1-4b01-b0d9-6a67c1a0e9c5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:25.655927 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97801215-3ee1-4b01-b0d9-6a67c1a0e9c5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:25.656425 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97801215-3ee1-4b01-b0d9-6a67c1a0e9c5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:25.656956 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97801215-3ee1-4b01-b0d9-6a67c1a0e9c5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:25.689895 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97801215-3ee1-4b01-b0d9-6a67c1a0e9c5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:25.690380 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97801215-3ee1-4b01-b0d9-6a67c1a0e9c5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:25.690824 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97801215-3ee1-4b01-b0d9-6a67c1a0e9c5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:25.691285 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.objects.instance [None req-97801215-3ee1-4b01-b0d9-6a67c1a0e9c5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lazy-loading 'fault' on Instance uuid c70a39ae-b902-41c8-a735-c48983629b25 {{(pid=133014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:45:25.736222 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-97801215-3ee1-4b01-b0d9-6a67c1a0e9c5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d4eafe59c4c8180eece8ec9283e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b2e8bdb934d94a25fe4b355e73c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:25.744101 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-97801215-3ee1-4b01-b0d9-6a67c1a0e9c5 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25" status: 200 len: 1331 microversion: 2.1 time: 0.100099 Aug 24 13:45:25.744781 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 404/825] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:25 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:25.965222 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-d3dc0336-9a58-4c37-a9ab-1a99f5147424 req-45c3d7a9-b5b4-4732-ad65-8c08e04e2b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c70a39ae-b902-41c8-a735-c48983629b25", "name": "network-vif-deleted", "tag": "a4155bd9-091b-424f-94b6-1d07874966f0"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:45:25.974914 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-d3dc0336-9a58-4c37-a9ab-1a99f5147424 req-45c3d7a9-b5b4-4732-ad65-8c08e04e2b46 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:25.975713 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-d3dc0336-9a58-4c37-a9ab-1a99f5147424 req-45c3d7a9-b5b4-4732-ad65-8c08e04e2b46 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:25.976542 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-d3dc0336-9a58-4c37-a9ab-1a99f5147424 req-45c3d7a9-b5b4-4732-ad65-8c08e04e2b46 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:25.997118 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-d3dc0336-9a58-4c37-a9ab-1a99f5147424 req-45c3d7a9-b5b4-4732-ad65-8c08e04e2b46 service nova] Creating event network-vif-deleted:a4155bd9-091b-424f-94b6-1d07874966f0 for instance c70a39ae-b902-41c8-a735-c48983629b25 on hv-cinder-77957 Aug 24 13:45:26.003272 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-d3dc0336-9a58-4c37-a9ab-1a99f5147424 req-45c3d7a9-b5b4-4732-ad65-8c08e04e2b46 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041745 Aug 24 13:45:26.003888 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 422/826] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:45:26.491533 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-0867f090-c614-4d42-849f-3ad14d0f76ae tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:26.492160 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-0867f090-c614-4d42-849f-3ad14d0f76ae tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: fbe90b5c-a710-43ee-b3a8-773a37849056] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:26.498603 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0867f090-c614-4d42-849f-3ad14d0f76ae tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:26.499178 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0867f090-c614-4d42-849f-3ad14d0f76ae tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:26.499672 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0867f090-c614-4d42-849f-3ad14d0f76ae tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:26.500465 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0867f090-c614-4d42-849f-3ad14d0f76ae tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:26.501611 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0867f090-c614-4d42-849f-3ad14d0f76ae tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:26.502159 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0867f090-c614-4d42-849f-3ad14d0f76ae tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:26.517774 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-0867f090-c614-4d42-849f-3ad14d0f76ae tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] HTTP exception thrown: Instance fbe90b5c-a710-43ee-b3a8-773a37849056 could not be found. Aug 24 13:45:26.518231 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-0c86bd05-ce4e-43e1-8463-eab7f43017a9 req-9bfcb826-ed5e-4f41-8c06-eed29972dd9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1118fb04-6744-4b7c-b639-0081073ee53a", "name": "network-vif-plugged", "status": "completed", "tag": "579a6bec-e4ab-438a-a263-2fafa0fe42bc"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:45:26.522075 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-0867f090-c614-4d42-849f-3ad14d0f76ae tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Request method failure captured: Aug 24 13:45:26.522075 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 HTTP/1.1 Aug 24 13:45:26.522075 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:45:26.522075 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:45:26.522075 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:45:26.522075 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:45:26.522075 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:45:26.522075 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:45:26.522075 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:45:26.522075 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:45:26.522075 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBio-vt113GyIGAINLSzOWx94ASYzerXaZEv5YREo1TToDpvzKyjcRowpvDgdJaKCc7yo4wyulaPEgIjpHjojWeA6p7mHKzAe5aa4pnmTJ73FsHansramwsQRGoDLdIydz44BXnhPycna7G2wYedVilx-YfOCQ3CHOnMCEUjDFP26dAs Aug 24 13:45:26.522075 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:45:26.522075 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:45:26.522075 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:45:26.522075 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:45:26.522075 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:45:26.522075 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:45:26.522075 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 127e5da55b164ce68568c153fee58baf Aug 24 13:45:26.522075 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1606015574 Aug 24 13:45:26.522075 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:45:26.522075 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:45:26.523717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/127e5da55b164ce68568c153fee58baf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/127e5da55b164ce68568c153fee58baf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_127e5da55b164ce68568c153fee58baf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/127e5da55b164ce68568c153fee58baf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:45:26.523717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1606015574 Aug 24 13:45:26.523717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 127e5da55b164ce68568c153fee58baf Aug 24 13:45:26.523717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1606015574 Aug 24 13:45:26.523717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-ServerRescueNegativeTestJSON-1606015574-project Aug 24 13:45:26.523717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:45:26.523717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:45:26.523717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: adb792e7246d42dface4aa52899a0ffc Aug 24 13:45:26.523717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1606015574-project Aug 24 13:45:26.523717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:45:26.523717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Instance fbe90b5c-a710-43ee-b3a8-773a37849056 could not be found. Aug 24 13:45:26.523717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': 'fbe90b5c-a710-43ee-b3a8-773a37849056'} Aug 24 13:45:26.524831 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:45:26.524831 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:26.524831 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:45:26.524831 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:45:26.524831 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:45:26.524831 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:45:26.524831 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:45:26.524831 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:45:26.524831 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:45:26.524831 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:45:26.524831 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbe90b5c-a710-43ee-b3a8-773a37849056 could not be found. Aug 24 13:45:26.524831 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:26.524831 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:26.524831 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:26.524831 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:26.524831 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:26.524831 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:26.524831 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:45:26.524831 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:45:26.524831 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:45:26.526338 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:45:26.526338 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:45:26.526338 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:45:26.526338 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:45:26.526338 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:45:26.526338 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:45:26.526338 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:45:26.526338 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbe90b5c-a710-43ee-b3a8-773a37849056 could not be found. Aug 24 13:45:26.526338 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:26.526338 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:26.526338 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:26.526338 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:26.526338 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:26.526338 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:26.526338 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:45:26.526338 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:45:26.526338 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbe90b5c-a710-43ee-b3a8-773a37849056 could not be found. Aug 24 13:45:26.526338 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:26.527676 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-0867f090-c614-4d42-849f-3ad14d0f76ae tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Returning 404 to user: Instance fbe90b5c-a710-43ee-b3a8-773a37849056 could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:45:26.527676 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-0867f090-c614-4d42-849f-3ad14d0f76ae tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056" status: 404 len: 111 microversion: 2.1 time: 0.033841 Aug 24 13:45:26.527676 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 405/827] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:26 2022] GET /compute/v2.1/servers/fbe90b5c-a710-43ee-b3a8-773a37849056 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:45:26.529751 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-981e2ad7-e5b8-4330-bd94-e5cb6c821dea tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:26.530250 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-981e2ad7-e5b8-4330-bd94-e5cb6c821dea tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:26.536268 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-0c86bd05-ce4e-43e1-8463-eab7f43017a9 req-9bfcb826-ed5e-4f41-8c06-eed29972dd9a service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:26.536562 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-981e2ad7-e5b8-4330-bd94-e5cb6c821dea tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:26.536756 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-0c86bd05-ce4e-43e1-8463-eab7f43017a9 req-9bfcb826-ed5e-4f41-8c06-eed29972dd9a service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:26.537046 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-981e2ad7-e5b8-4330-bd94-e5cb6c821dea tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:26.537203 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-0c86bd05-ce4e-43e1-8463-eab7f43017a9 req-9bfcb826-ed5e-4f41-8c06-eed29972dd9a service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:26.537477 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-981e2ad7-e5b8-4330-bd94-e5cb6c821dea tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:26.538162 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-981e2ad7-e5b8-4330-bd94-e5cb6c821dea tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:26.538613 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-981e2ad7-e5b8-4330-bd94-e5cb6c821dea tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:26.539035 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-981e2ad7-e5b8-4330-bd94-e5cb6c821dea tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:26.555471 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-0c86bd05-ce4e-43e1-8463-eab7f43017a9 req-9bfcb826-ed5e-4f41-8c06-eed29972dd9a service nova] Creating event network-vif-plugged:579a6bec-e4ab-438a-a263-2fafa0fe42bc for instance 1118fb04-6744-4b7c-b639-0081073ee53a on hv-cinder-77957 Aug 24 13:45:26.560859 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-0c86bd05-ce4e-43e1-8463-eab7f43017a9 req-9bfcb826-ed5e-4f41-8c06-eed29972dd9a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046918 Aug 24 13:45:26.561513 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 423/828] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:45:26.566938 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-981e2ad7-e5b8-4330-bd94-e5cb6c821dea tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Going to try to terminate instance {{(pid=133014) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 13:45:26.676278 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-9da22221-8167-4ff0-a822-57627a3ae643 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:26.677001 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-9da22221-8167-4ff0-a822-57627a3ae643 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:26.684803 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9da22221-8167-4ff0-a822-57627a3ae643 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:26.685013 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9da22221-8167-4ff0-a822-57627a3ae643 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:26.685451 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9da22221-8167-4ff0-a822-57627a3ae643 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:26.686159 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9da22221-8167-4ff0-a822-57627a3ae643 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:26.686616 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9da22221-8167-4ff0-a822-57627a3ae643 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:26.687037 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9da22221-8167-4ff0-a822-57627a3ae643 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:26.825542 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-9da22221-8167-4ff0-a822-57627a3ae643 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:26.833709 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-9da22221-8167-4ff0-a822-57627a3ae643 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1577 microversion: 2.1 time: 0.163571 Aug 24 13:45:26.834296 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 424/829] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:26 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:45:26.838952 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-75b53f95-029c-468c-b5fe-db3f05140a4a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:26.839546 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-75b53f95-029c-468c-b5fe-db3f05140a4a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:26.846473 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-75b53f95-029c-468c-b5fe-db3f05140a4a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:26.847142 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-75b53f95-029c-468c-b5fe-db3f05140a4a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:26.847569 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-75b53f95-029c-468c-b5fe-db3f05140a4a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:26.848303 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-75b53f95-029c-468c-b5fe-db3f05140a4a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:26.848748 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-75b53f95-029c-468c-b5fe-db3f05140a4a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:26.849270 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-75b53f95-029c-468c-b5fe-db3f05140a4a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:26.865065 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.wsgi [None req-75b53f95-029c-468c-b5fe-db3f05140a4a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] HTTP exception thrown: Instance c70a39ae-b902-41c8-a735-c48983629b25 could not be found. Aug 24 13:45:26.866781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-75b53f95-029c-468c-b5fe-db3f05140a4a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Request method failure captured: Aug 24 13:45:26.866781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 HTTP/1.1 Aug 24 13:45:26.866781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:45:26.866781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:45:26.866781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:45:26.866781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 0 Aug 24 13:45:26.866781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:45:26.866781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:45:26.866781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:45:26.866781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:45:26.866781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBinWm1p0b_H31lzxpPvzbV7rjy3F8Qzyn9V8PX7wwFXRHJCaJ71LLFkZ_Lkt8k4m1f9ymfMSrmW4KTZotPqVtGf-HmA9MGnpTEXSHWlAWKAH6WNjAbNhI-4NP4nK3tGleZkG8cnaBgxLFes9pTCCxx0p3rv03UC4QT5l95RSPxVokdw Aug 24 13:45:26.866781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:45:26.866781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:45:26.866781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:45:26.866781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:45:26.866781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:45:26.866781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:45:26.866781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:45:26.866781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:26.866781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:45:26.866781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:45:26.868363 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:45:26.868363 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:26.868363 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:45:26.868363 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:26.868363 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:45:26.868363 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:45:26.868363 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:45:26.868363 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: ea9d4eafe59c4c8180eece8ec9283e40 Aug 24 13:45:26.868363 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:45:26.868363 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: > Aug 24 13:45:26.868363 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Instance c70a39ae-b902-41c8-a735-c48983629b25 could not be found. Aug 24 13:45:26.868363 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'id': 'c70a39ae-b902-41c8-a735-c48983629b25'} Aug 24 13:45:26.869257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:45:26.869257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:26.869257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:45:26.869257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:45:26.869257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:45:26.869257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:45:26.869257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:45:26.869257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:45:26.869257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:45:26.869257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:45:26.869257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c70a39ae-b902-41c8-a735-c48983629b25 could not be found. Aug 24 13:45:26.869257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:26.869257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:26.869257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:26.869257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:26.869257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:26.869257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:26.869257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:45:26.869257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:45:26.869257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:45:26.870418 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:45:26.870418 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:45:26.870418 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:45:26.870418 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:45:26.870418 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:45:26.870418 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:45:26.870418 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:45:26.870418 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c70a39ae-b902-41c8-a735-c48983629b25 could not be found. Aug 24 13:45:26.870418 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:26.870418 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:26.870418 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:26.870418 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:26.870418 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:26.870418 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:26.870418 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:45:26.870418 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:45:26.870418 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c70a39ae-b902-41c8-a735-c48983629b25 could not be found. Aug 24 13:45:26.870418 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:26.871539 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-75b53f95-029c-468c-b5fe-db3f05140a4a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Returning 404 to user: Instance c70a39ae-b902-41c8-a735-c48983629b25 could not be found. {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:45:26.871539 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-75b53f95-029c-468c-b5fe-db3f05140a4a tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25" status: 404 len: 111 microversion: 2.1 time: 0.032823 Aug 24 13:45:26.871539 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 425/830] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:26 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:45:26.877540 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-6f02eba3-b81a-4b10-847a-dd39eff1d5fc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '.version_select at 0x7f96c20199d0>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:26.903225 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-981e2ad7-e5b8-4330-bd94-e5cb6c821dea tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "DELETE /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 204 len: 0 microversion: 2.1 time: 0.377181 Aug 24 13:45:26.903807 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 406/831] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:45:26 2022] DELETE /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 13:45:26.914281 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-125685fb-a368-4e3a-8495-659410fc3b8d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:26.914997 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-125685fb-a368-4e3a-8495-659410fc3b8d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:26.921834 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-125685fb-a368-4e3a-8495-659410fc3b8d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:26.922355 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-125685fb-a368-4e3a-8495-659410fc3b8d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:26.923438 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-125685fb-a368-4e3a-8495-659410fc3b8d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:26.924144 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-125685fb-a368-4e3a-8495-659410fc3b8d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:26.924619 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-125685fb-a368-4e3a-8495-659410fc3b8d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:26.925039 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-125685fb-a368-4e3a-8495-659410fc3b8d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:26.990744 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-6f02eba3-b81a-4b10-847a-dd39eff1d5fc tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085277291" status: 202 len: 0 microversion: 2.1 time: 0.117520 Aug 24 13:45:26.991329 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 426/832] 10.222.0.73 () {58 vars in 1221 bytes} [Wed Aug 24 13:45:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085277291 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 13:45:27.077470 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-125685fb-a368-4e3a-8495-659410fc3b8d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:27.085806 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-125685fb-a368-4e3a-8495-659410fc3b8d tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.176567 Aug 24 13:45:27.086391 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 407/833] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:26 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:45:27.856784 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-6f41b50d-5ff9-457c-92eb-c56cf40f996a tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:27.857523 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-6f41b50d-5ff9-457c-92eb-c56cf40f996a tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:27.865092 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f41b50d-5ff9-457c-92eb-c56cf40f996a tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:27.865578 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f41b50d-5ff9-457c-92eb-c56cf40f996a tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:27.866009 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f41b50d-5ff9-457c-92eb-c56cf40f996a tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:27.866743 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f41b50d-5ff9-457c-92eb-c56cf40f996a tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:27.867197 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f41b50d-5ff9-457c-92eb-c56cf40f996a tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:27.867618 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6f41b50d-5ff9-457c-92eb-c56cf40f996a tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:28.002972 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-6f41b50d-5ff9-457c-92eb-c56cf40f996a tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:28.010787 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-6f41b50d-5ff9-457c-92eb-c56cf40f996a tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1577 microversion: 2.1 time: 0.158593 Aug 24 13:45:28.011353 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 427/834] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:27 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:28.106699 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-36ba48df-f30b-48ad-9509-f99e62391168 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:28.107348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-36ba48df-f30b-48ad-9509-f99e62391168 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:28.114515 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-36ba48df-f30b-48ad-9509-f99e62391168 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:28.115002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-36ba48df-f30b-48ad-9509-f99e62391168 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:28.115433 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-36ba48df-f30b-48ad-9509-f99e62391168 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:28.116225 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-36ba48df-f30b-48ad-9509-f99e62391168 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:28.116679 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-36ba48df-f30b-48ad-9509-f99e62391168 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:28.117098 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-36ba48df-f30b-48ad-9509-f99e62391168 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:28.258992 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-36ba48df-f30b-48ad-9509-f99e62391168 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:28.266801 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-36ba48df-f30b-48ad-9509-f99e62391168 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.163826 Aug 24 13:45:28.267370 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 408/835] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:28 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:29.033002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-712f736d-d2d3-4764-af61-d85ba36a83f1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:29.033626 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-712f736d-d2d3-4764-af61-d85ba36a83f1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:29.040143 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-712f736d-d2d3-4764-af61-d85ba36a83f1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:29.040650 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-712f736d-d2d3-4764-af61-d85ba36a83f1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:29.041083 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-712f736d-d2d3-4764-af61-d85ba36a83f1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:29.041761 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-712f736d-d2d3-4764-af61-d85ba36a83f1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:29.042209 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-712f736d-d2d3-4764-af61-d85ba36a83f1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:29.042627 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-712f736d-d2d3-4764-af61-d85ba36a83f1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:29.136460 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a64218eb-15e0-4547-b5d8-8435e3e8f8c1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:29.137045 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a64218eb-15e0-4547-b5d8-8435e3e8f8c1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:29.144411 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a64218eb-15e0-4547-b5d8-8435e3e8f8c1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:29.144909 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a64218eb-15e0-4547-b5d8-8435e3e8f8c1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:29.145348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a64218eb-15e0-4547-b5d8-8435e3e8f8c1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:29.146044 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a64218eb-15e0-4547-b5d8-8435e3e8f8c1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:29.146503 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a64218eb-15e0-4547-b5d8-8435e3e8f8c1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:29.146928 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a64218eb-15e0-4547-b5d8-8435e3e8f8c1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:29.160791 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-a64218eb-15e0-4547-b5d8-8435e3e8f8c1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] HTTP exception thrown: Instance c70a39ae-b902-41c8-a735-c48983629b25 could not be found. Aug 24 13:45:29.162471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a64218eb-15e0-4547-b5d8-8435e3e8f8c1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Request method failure captured: Aug 24 13:45:29.162471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: DELETE /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 HTTP/1.1 Aug 24 13:45:29.162471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:45:29.162471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:45:29.162471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:45:29.162471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:45:29.162471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:45:29.162471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:45:29.162471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:45:29.162471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:45:29.162471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBinWm1p0b_H31lzxpPvzbV7rjy3F8Qzyn9V8PX7wwFXRHJCaJ71LLFkZ_Lkt8k4m1f9ymfMSrmW4KTZotPqVtGf-HmA9MGnpTEXSHWlAWKAH6WNjAbNhI-4NP4nK3tGleZkG8cnaBgxLFes9pTCCxx0p3rv03UC4QT5l95RSPxVokdw Aug 24 13:45:29.162471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:45:29.162471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:45:29.162471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:45:29.162471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:45:29.162471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:45:29.162471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:45:29.162471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:45:29.162471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:29.162471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:45:29.162471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:45:29.164339 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:45:29.164339 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:29.164339 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:45:29.164339 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:29.164339 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:45:29.164339 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:45:29.164339 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:45:29.164339 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: ea9d4eafe59c4c8180eece8ec9283e40 Aug 24 13:45:29.164339 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:45:29.164339 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:45:29.164339 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Instance c70a39ae-b902-41c8-a735-c48983629b25 could not be found. Aug 24 13:45:29.164339 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': 'c70a39ae-b902-41c8-a735-c48983629b25'} Aug 24 13:45:29.165166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:45:29.165166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:29.165166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:45:29.165166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:45:29.165166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:45:29.165166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:45:29.165166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:45:29.165166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:45:29.165166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:45:29.165166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:45:29.165166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c70a39ae-b902-41c8-a735-c48983629b25 could not be found. Aug 24 13:45:29.165166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:29.165166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:29.165166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:29.165166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:29.165166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:29.165166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:29.165166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:45:29.165166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:45:29.165166 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:45:29.166348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:45:29.166348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 13:45:29.166348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 13:45:29.166348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 13:45:29.166348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 13:45:29.166348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:45:29.166348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:45:29.166348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:45:29.166348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:45:29.166348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c70a39ae-b902-41c8-a735-c48983629b25 could not be found. Aug 24 13:45:29.166348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:29.166348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:29.166348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:29.166348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:29.166348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:29.166348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:29.166348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:45:29.166348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:45:29.166348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c70a39ae-b902-41c8-a735-c48983629b25 could not be found. Aug 24 13:45:29.166348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:29.167598 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a64218eb-15e0-4547-b5d8-8435e3e8f8c1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Returning 404 to user: Instance c70a39ae-b902-41c8-a735-c48983629b25 could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:45:29.167598 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a64218eb-15e0-4547-b5d8-8435e3e8f8c1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25" status: 404 len: 111 microversion: 2.1 time: 0.031419 Aug 24 13:45:29.167598 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 409/836] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:45:29 2022] DELETE /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:45:29.172279 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e30f6a2c-100f-4697-89aa-a4fe84d926a0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:29.173080 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-e30f6a2c-100f-4697-89aa-a4fe84d926a0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: c70a39ae-b902-41c8-a735-c48983629b25] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:29.179065 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e30f6a2c-100f-4697-89aa-a4fe84d926a0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:29.179551 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e30f6a2c-100f-4697-89aa-a4fe84d926a0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:29.179988 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e30f6a2c-100f-4697-89aa-a4fe84d926a0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:29.180757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e30f6a2c-100f-4697-89aa-a4fe84d926a0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:29.181216 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e30f6a2c-100f-4697-89aa-a4fe84d926a0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:29.181641 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e30f6a2c-100f-4697-89aa-a4fe84d926a0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:29.187015 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-712f736d-d2d3-4764-af61-d85ba36a83f1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:29.196991 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-712f736d-d2d3-4764-af61-d85ba36a83f1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1577 microversion: 2.1 time: 0.168500 Aug 24 13:45:29.197613 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 428/837] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:29 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:29.197784 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-e30f6a2c-100f-4697-89aa-a4fe84d926a0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] HTTP exception thrown: Instance c70a39ae-b902-41c8-a735-c48983629b25 could not be found. Aug 24 13:45:29.199329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e30f6a2c-100f-4697-89aa-a4fe84d926a0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Request method failure captured: Aug 24 13:45:29.199329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 HTTP/1.1 Aug 24 13:45:29.199329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:45:29.199329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:45:29.199329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:45:29.199329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:45:29.199329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:45:29.199329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:45:29.199329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:45:29.199329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:45:29.199329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBinWm1p0b_H31lzxpPvzbV7rjy3F8Qzyn9V8PX7wwFXRHJCaJ71LLFkZ_Lkt8k4m1f9ymfMSrmW4KTZotPqVtGf-HmA9MGnpTEXSHWlAWKAH6WNjAbNhI-4NP4nK3tGleZkG8cnaBgxLFes9pTCCxx0p3rv03UC4QT5l95RSPxVokdw Aug 24 13:45:29.199329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:45:29.199329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:45:29.199329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:45:29.199329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:45:29.199329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:45:29.199329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:45:29.199329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:45:29.199329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:29.199329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:45:29.199329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:45:29.201303 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:45:29.201303 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:29.201303 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:45:29.201303 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:29.201303 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:45:29.201303 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:45:29.201303 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:45:29.201303 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: ea9d4eafe59c4c8180eece8ec9283e40 Aug 24 13:45:29.201303 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:45:29.201303 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:45:29.201303 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Instance c70a39ae-b902-41c8-a735-c48983629b25 could not be found. Aug 24 13:45:29.201303 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': 'c70a39ae-b902-41c8-a735-c48983629b25'} Aug 24 13:45:29.202110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:45:29.202110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:29.202110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:45:29.202110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:45:29.202110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:45:29.202110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:45:29.202110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:45:29.202110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:45:29.202110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:45:29.202110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:45:29.202110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c70a39ae-b902-41c8-a735-c48983629b25 could not be found. Aug 24 13:45:29.202110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:29.202110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:29.202110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:29.202110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:29.202110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:29.202110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:29.202110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:45:29.202110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:45:29.202110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:45:29.203532 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:45:29.203532 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:45:29.203532 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:45:29.203532 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:45:29.203532 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:45:29.203532 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:45:29.203532 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:45:29.203532 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c70a39ae-b902-41c8-a735-c48983629b25 could not be found. Aug 24 13:45:29.203532 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:29.203532 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:29.203532 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:29.203532 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:29.203532 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:29.203532 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:29.203532 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:45:29.203532 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:45:29.203532 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c70a39ae-b902-41c8-a735-c48983629b25 could not be found. Aug 24 13:45:29.203532 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:29.204805 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e30f6a2c-100f-4697-89aa-a4fe84d926a0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Returning 404 to user: Instance c70a39ae-b902-41c8-a735-c48983629b25 could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:45:29.204805 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-e30f6a2c-100f-4697-89aa-a4fe84d926a0 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25" status: 404 len: 111 microversion: 2.1 time: 0.032320 Aug 24 13:45:29.204805 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 410/838] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:29 2022] GET /compute/v2.1/servers/c70a39ae-b902-41c8-a735-c48983629b25 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 13:45:29.287167 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-7b12fc59-7843-4dc1-999a-be2abc73d6ae tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:29.287696 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-7b12fc59-7843-4dc1-999a-be2abc73d6ae tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:29.293809 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7b12fc59-7843-4dc1-999a-be2abc73d6ae tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:29.294283 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7b12fc59-7843-4dc1-999a-be2abc73d6ae tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:29.294713 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7b12fc59-7843-4dc1-999a-be2abc73d6ae tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:29.295398 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7b12fc59-7843-4dc1-999a-be2abc73d6ae tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:29.295847 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7b12fc59-7843-4dc1-999a-be2abc73d6ae tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:29.296301 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7b12fc59-7843-4dc1-999a-be2abc73d6ae tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:29.435055 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-7b12fc59-7843-4dc1-999a-be2abc73d6ae tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:29.442326 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-7b12fc59-7843-4dc1-999a-be2abc73d6ae tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.159105 Aug 24 13:45:29.442895 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 429/839] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:29 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:30.219309 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e0cd6806-979c-41e4-8971-ab486e9c96f9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:30.219958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-e0cd6806-979c-41e4-8971-ab486e9c96f9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:30.227557 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e0cd6806-979c-41e4-8971-ab486e9c96f9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:30.228042 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e0cd6806-979c-41e4-8971-ab486e9c96f9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:30.228506 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e0cd6806-979c-41e4-8971-ab486e9c96f9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:30.229207 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e0cd6806-979c-41e4-8971-ab486e9c96f9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:30.229662 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e0cd6806-979c-41e4-8971-ab486e9c96f9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:30.230084 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e0cd6806-979c-41e4-8971-ab486e9c96f9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:30.366187 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e0cd6806-979c-41e4-8971-ab486e9c96f9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:30.373908 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-e0cd6806-979c-41e4-8971-ab486e9c96f9 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1577 microversion: 2.1 time: 0.158516 Aug 24 13:45:30.374472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 411/840] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:30 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:30.462905 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-6e156e90-a35d-4d60-92ef-ae3030da0cc2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:30.463600 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-6e156e90-a35d-4d60-92ef-ae3030da0cc2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:30.471341 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6e156e90-a35d-4d60-92ef-ae3030da0cc2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:30.471867 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6e156e90-a35d-4d60-92ef-ae3030da0cc2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:30.472337 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6e156e90-a35d-4d60-92ef-ae3030da0cc2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:30.473048 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6e156e90-a35d-4d60-92ef-ae3030da0cc2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:30.473502 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6e156e90-a35d-4d60-92ef-ae3030da0cc2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:30.473931 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6e156e90-a35d-4d60-92ef-ae3030da0cc2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:30.474230 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a27f02f8-ba2b-4b6a-ac0a-21ac7fdcd0a1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:30.474858 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a27f02f8-ba2b-4b6a-ac0a-21ac7fdcd0a1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:30.480941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a27f02f8-ba2b-4b6a-ac0a-21ac7fdcd0a1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:30.481610 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a27f02f8-ba2b-4b6a-ac0a-21ac7fdcd0a1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:30.482044 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a27f02f8-ba2b-4b6a-ac0a-21ac7fdcd0a1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:30.482730 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a27f02f8-ba2b-4b6a-ac0a-21ac7fdcd0a1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:30.483214 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a27f02f8-ba2b-4b6a-ac0a-21ac7fdcd0a1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:30.483637 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a27f02f8-ba2b-4b6a-ac0a-21ac7fdcd0a1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:30.497451 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-a27f02f8-ba2b-4b6a-ac0a-21ac7fdcd0a1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] HTTP exception thrown: Instance 5fb46333-4237-44a1-8a88-7d5171bfdb84 could not be found. Aug 24 13:45:30.499079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a27f02f8-ba2b-4b6a-ac0a-21ac7fdcd0a1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Request method failure captured: Aug 24 13:45:30.499079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: DELETE /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84 HTTP/1.1 Aug 24 13:45:30.499079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:45:30.499079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:45:30.499079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:45:30.499079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:45:30.499079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:45:30.499079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:45:30.499079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:45:30.499079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:45:30.499079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBinWm1p0b_H31lzxpPvzbV7rjy3F8Qzyn9V8PX7wwFXRHJCaJ71LLFkZ_Lkt8k4m1f9ymfMSrmW4KTZotPqVtGf-HmA9MGnpTEXSHWlAWKAH6WNjAbNhI-4NP4nK3tGleZkG8cnaBgxLFes9pTCCxx0p3rv03UC4QT5l95RSPxVokdw Aug 24 13:45:30.499079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:45:30.499079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:45:30.499079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:45:30.499079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:45:30.499079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:45:30.499079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:45:30.499079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:45:30.499079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:30.499079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:45:30.499079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:45:30.500588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:45:30.500588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:30.500588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:45:30.500588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:30.500588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:45:30.500588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:45:30.500588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:45:30.500588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: ea9d4eafe59c4c8180eece8ec9283e40 Aug 24 13:45:30.500588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:45:30.500588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:45:30.500588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Instance 5fb46333-4237-44a1-8a88-7d5171bfdb84 could not be found. Aug 24 13:45:30.500588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': '5fb46333-4237-44a1-8a88-7d5171bfdb84'} Aug 24 13:45:30.501317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:45:30.501317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:30.501317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:45:30.501317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:45:30.501317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:45:30.501317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:45:30.501317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:45:30.501317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:45:30.501317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:45:30.501317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:45:30.501317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb46333-4237-44a1-8a88-7d5171bfdb84 could not be found. Aug 24 13:45:30.501317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:30.501317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:30.501317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:30.501317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:30.501317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:30.501317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:30.501317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:45:30.501317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:45:30.501317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:45:30.503009 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:45:30.503009 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 13:45:30.503009 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 13:45:30.503009 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 13:45:30.503009 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 13:45:30.503009 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:45:30.503009 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:45:30.503009 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:45:30.503009 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:45:30.503009 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb46333-4237-44a1-8a88-7d5171bfdb84 could not be found. Aug 24 13:45:30.503009 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:30.503009 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:30.503009 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:30.503009 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:30.503009 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:30.503009 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:30.503009 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:45:30.503009 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:45:30.503009 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb46333-4237-44a1-8a88-7d5171bfdb84 could not be found. Aug 24 13:45:30.503009 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:30.504298 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a27f02f8-ba2b-4b6a-ac0a-21ac7fdcd0a1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Returning 404 to user: Instance 5fb46333-4237-44a1-8a88-7d5171bfdb84 could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:45:30.504298 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a27f02f8-ba2b-4b6a-ac0a-21ac7fdcd0a1 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84" status: 404 len: 111 microversion: 2.1 time: 0.030641 Aug 24 13:45:30.504298 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 412/841] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:45:30 2022] DELETE /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 13:45:30.509774 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-18727c03-cffd-410c-a08e-f3c923dc1f6c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:30.510380 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-18727c03-cffd-410c-a08e-f3c923dc1f6c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 5fb46333-4237-44a1-8a88-7d5171bfdb84] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:30.516469 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-18727c03-cffd-410c-a08e-f3c923dc1f6c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:30.516952 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-18727c03-cffd-410c-a08e-f3c923dc1f6c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:30.517382 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-18727c03-cffd-410c-a08e-f3c923dc1f6c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:30.518737 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-18727c03-cffd-410c-a08e-f3c923dc1f6c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:30.519185 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-18727c03-cffd-410c-a08e-f3c923dc1f6c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:30.519604 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-18727c03-cffd-410c-a08e-f3c923dc1f6c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:30.533895 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-18727c03-cffd-410c-a08e-f3c923dc1f6c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] HTTP exception thrown: Instance 5fb46333-4237-44a1-8a88-7d5171bfdb84 could not be found. Aug 24 13:45:30.535439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-18727c03-cffd-410c-a08e-f3c923dc1f6c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Request method failure captured: Aug 24 13:45:30.535439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84 HTTP/1.1 Aug 24 13:45:30.535439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:45:30.535439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:45:30.535439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:45:30.535439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:45:30.535439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:45:30.535439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:45:30.535439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:45:30.535439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:45:30.535439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBinWm1p0b_H31lzxpPvzbV7rjy3F8Qzyn9V8PX7wwFXRHJCaJ71LLFkZ_Lkt8k4m1f9ymfMSrmW4KTZotPqVtGf-HmA9MGnpTEXSHWlAWKAH6WNjAbNhI-4NP4nK3tGleZkG8cnaBgxLFes9pTCCxx0p3rv03UC4QT5l95RSPxVokdw Aug 24 13:45:30.535439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:45:30.535439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:45:30.535439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:45:30.535439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:45:30.535439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:45:30.535439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:45:30.535439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:45:30.535439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:30.535439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:45:30.535439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:45:30.536826 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:45:30.536826 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:30.536826 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:45:30.536826 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:30.536826 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:45:30.536826 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:45:30.536826 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:45:30.536826 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: ea9d4eafe59c4c8180eece8ec9283e40 Aug 24 13:45:30.536826 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:45:30.536826 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:45:30.536826 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Instance 5fb46333-4237-44a1-8a88-7d5171bfdb84 could not be found. Aug 24 13:45:30.536826 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': '5fb46333-4237-44a1-8a88-7d5171bfdb84'} Aug 24 13:45:30.537588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:45:30.537588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:30.537588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:45:30.537588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:45:30.537588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:45:30.537588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:45:30.537588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:45:30.537588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:45:30.537588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:45:30.537588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:45:30.537588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb46333-4237-44a1-8a88-7d5171bfdb84 could not be found. Aug 24 13:45:30.537588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:30.537588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:30.537588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:30.537588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:30.537588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:30.537588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:30.537588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:45:30.537588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:45:30.537588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:45:30.538778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:45:30.538778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:45:30.538778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:45:30.538778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:45:30.538778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:45:30.538778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:45:30.538778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:45:30.538778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb46333-4237-44a1-8a88-7d5171bfdb84 could not be found. Aug 24 13:45:30.538778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:30.538778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:30.538778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:30.538778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:30.538778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:30.538778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:30.538778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:45:30.538778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:45:30.538778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb46333-4237-44a1-8a88-7d5171bfdb84 could not be found. Aug 24 13:45:30.538778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:30.539836 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-18727c03-cffd-410c-a08e-f3c923dc1f6c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Returning 404 to user: Instance 5fb46333-4237-44a1-8a88-7d5171bfdb84 could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:45:30.539836 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-18727c03-cffd-410c-a08e-f3c923dc1f6c tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84" status: 404 len: 111 microversion: 2.1 time: 0.030814 Aug 24 13:45:30.539836 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 413/842] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:30 2022] GET /compute/v2.1/servers/5fb46333-4237-44a1-8a88-7d5171bfdb84 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:45:30.545161 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-5ca0d037-9cc4-4039-ba58-6a6d214e7c03 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:30.545655 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-5ca0d037-9cc4-4039-ba58-6a6d214e7c03 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:30.552513 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5ca0d037-9cc4-4039-ba58-6a6d214e7c03 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:30.552513 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5ca0d037-9cc4-4039-ba58-6a6d214e7c03 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:30.552934 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5ca0d037-9cc4-4039-ba58-6a6d214e7c03 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:30.553519 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5ca0d037-9cc4-4039-ba58-6a6d214e7c03 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:30.553964 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5ca0d037-9cc4-4039-ba58-6a6d214e7c03 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:30.554382 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5ca0d037-9cc4-4039-ba58-6a6d214e7c03 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:30.573437 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-5ca0d037-9cc4-4039-ba58-6a6d214e7c03 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] HTTP exception thrown: Instance 807615f2-1905-4a84-8a8b-574886415dc6 could not be found. Aug 24 13:45:30.575169 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-5ca0d037-9cc4-4039-ba58-6a6d214e7c03 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Request method failure captured: Aug 24 13:45:30.575169 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: DELETE /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 HTTP/1.1 Aug 24 13:45:30.575169 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:45:30.575169 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:45:30.575169 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:45:30.575169 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:45:30.575169 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:45:30.575169 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:45:30.575169 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:45:30.575169 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:45:30.575169 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBinWm1p0b_H31lzxpPvzbV7rjy3F8Qzyn9V8PX7wwFXRHJCaJ71LLFkZ_Lkt8k4m1f9ymfMSrmW4KTZotPqVtGf-HmA9MGnpTEXSHWlAWKAH6WNjAbNhI-4NP4nK3tGleZkG8cnaBgxLFes9pTCCxx0p3rv03UC4QT5l95RSPxVokdw Aug 24 13:45:30.575169 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:45:30.575169 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:45:30.575169 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:45:30.575169 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:45:30.575169 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:45:30.575169 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:45:30.575169 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:45:30.575169 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:30.575169 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:45:30.575169 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:45:30.576517 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:45:30.576517 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:30.576517 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:45:30.576517 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:30.576517 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:45:30.576517 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:45:30.576517 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:45:30.576517 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: ea9d4eafe59c4c8180eece8ec9283e40 Aug 24 13:45:30.576517 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:45:30.576517 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:45:30.576517 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Instance 807615f2-1905-4a84-8a8b-574886415dc6 could not be found. Aug 24 13:45:30.576517 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': '807615f2-1905-4a84-8a8b-574886415dc6'} Aug 24 13:45:30.577307 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:45:30.577307 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:30.577307 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:45:30.577307 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:45:30.577307 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:45:30.577307 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:45:30.577307 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:45:30.577307 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:45:30.577307 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:45:30.577307 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:45:30.577307 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 807615f2-1905-4a84-8a8b-574886415dc6 could not be found. Aug 24 13:45:30.577307 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:30.577307 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:30.577307 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:30.577307 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:30.577307 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:30.577307 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:30.577307 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:45:30.577307 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:45:30.577307 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:45:30.578635 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:45:30.578635 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 13:45:30.578635 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 13:45:30.578635 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 13:45:30.578635 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 13:45:30.578635 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:45:30.578635 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:45:30.578635 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:45:30.578635 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:45:30.578635 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 807615f2-1905-4a84-8a8b-574886415dc6 could not be found. Aug 24 13:45:30.578635 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:30.578635 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:30.578635 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:30.578635 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:30.578635 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:30.578635 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:30.578635 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:45:30.578635 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:45:30.578635 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 807615f2-1905-4a84-8a8b-574886415dc6 could not be found. Aug 24 13:45:30.578635 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:30.581520 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-5ca0d037-9cc4-4039-ba58-6a6d214e7c03 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Returning 404 to user: Instance 807615f2-1905-4a84-8a8b-574886415dc6 could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:45:30.581520 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-5ca0d037-9cc4-4039-ba58-6a6d214e7c03 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "DELETE /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6" status: 404 len: 111 microversion: 2.1 time: 0.035049 Aug 24 13:45:30.581520 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 414/843] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:45:30 2022] DELETE /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 13:45:30.586791 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-6b5c855a-3ce6-482b-bc09-392c3920d183 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:30.586791 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-6b5c855a-3ce6-482b-bc09-392c3920d183 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 807615f2-1905-4a84-8a8b-574886415dc6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:30.593562 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6b5c855a-3ce6-482b-bc09-392c3920d183 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:30.594058 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6b5c855a-3ce6-482b-bc09-392c3920d183 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:30.594501 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6b5c855a-3ce6-482b-bc09-392c3920d183 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:30.596549 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6b5c855a-3ce6-482b-bc09-392c3920d183 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:30.596549 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6b5c855a-3ce6-482b-bc09-392c3920d183 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:30.596797 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6b5c855a-3ce6-482b-bc09-392c3920d183 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:30.612752 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-6b5c855a-3ce6-482b-bc09-392c3920d183 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] HTTP exception thrown: Instance 807615f2-1905-4a84-8a8b-574886415dc6 could not be found. Aug 24 13:45:30.614440 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-6b5c855a-3ce6-482b-bc09-392c3920d183 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Request method failure captured: Aug 24 13:45:30.614440 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 HTTP/1.1 Aug 24 13:45:30.614440 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:45:30.614440 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:45:30.614440 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:45:30.614440 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:45:30.614440 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:45:30.614440 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:45:30.614440 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:45:30.614440 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:45:30.614440 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBinWm1p0b_H31lzxpPvzbV7rjy3F8Qzyn9V8PX7wwFXRHJCaJ71LLFkZ_Lkt8k4m1f9ymfMSrmW4KTZotPqVtGf-HmA9MGnpTEXSHWlAWKAH6WNjAbNhI-4NP4nK3tGleZkG8cnaBgxLFes9pTCCxx0p3rv03UC4QT5l95RSPxVokdw Aug 24 13:45:30.614440 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:45:30.614440 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:45:30.614440 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:45:30.614440 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:45:30.614440 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:45:30.614440 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:45:30.614440 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:45:30.614440 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:30.614440 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:45:30.614440 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:45:30.615979 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:45:30.615979 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:30.615979 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:45:30.615979 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:30.615979 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:45:30.615979 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:45:30.615979 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:45:30.615979 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: ea9d4eafe59c4c8180eece8ec9283e40 Aug 24 13:45:30.615979 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:45:30.615979 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:45:30.615979 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Instance 807615f2-1905-4a84-8a8b-574886415dc6 could not be found. Aug 24 13:45:30.615979 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': '807615f2-1905-4a84-8a8b-574886415dc6'} Aug 24 13:45:30.617827 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:45:30.617827 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:30.617827 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:45:30.617827 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:45:30.617827 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:45:30.617827 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:45:30.617827 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:45:30.617827 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:45:30.617827 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:45:30.617827 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:45:30.617827 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 807615f2-1905-4a84-8a8b-574886415dc6 could not be found. Aug 24 13:45:30.617827 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:30.617827 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:30.617827 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:30.617827 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:30.617827 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:30.617827 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:30.617827 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:45:30.617827 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:45:30.617827 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:45:30.620996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:45:30.620996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:45:30.620996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:45:30.620996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:45:30.620996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:45:30.620996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:45:30.620996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:45:30.620996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 807615f2-1905-4a84-8a8b-574886415dc6 could not be found. Aug 24 13:45:30.620996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:30.620996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:30.620996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:30.620996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:30.620996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:30.620996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:30.620996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:45:30.620996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:45:30.620996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 807615f2-1905-4a84-8a8b-574886415dc6 could not be found. Aug 24 13:45:30.620996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:30.623234 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-6b5c855a-3ce6-482b-bc09-392c3920d183 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Returning 404 to user: Instance 807615f2-1905-4a84-8a8b-574886415dc6 could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:45:30.623234 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-6b5c855a-3ce6-482b-bc09-392c3920d183 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6" status: 404 len: 111 microversion: 2.1 time: 0.034166 Aug 24 13:45:30.623234 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 415/844] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:30 2022] GET /compute/v2.1/servers/807615f2-1905-4a84-8a8b-574886415dc6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:45:30.626771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-6e156e90-a35d-4d60-92ef-ae3030da0cc2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:30.635631 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-6e156e90-a35d-4d60-92ef-ae3030da0cc2 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1522 microversion: 2.1 time: 0.176486 Aug 24 13:45:30.636230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 430/845] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:30 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:31.120263 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-a75eaae3-8302-45f6-85c4-81f362e1742f req-b3919e23-a4fb-47fd-94ca-9246c245ab6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08ba9691-685f-444a-9c86-9ac1562acbf0", "name": "network-vif-deleted", "tag": "88ef4e43-75b6-482c-8852-e8293b84a9ab"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:45:31.129847 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-a75eaae3-8302-45f6-85c4-81f362e1742f req-b3919e23-a4fb-47fd-94ca-9246c245ab6d service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:31.130327 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-a75eaae3-8302-45f6-85c4-81f362e1742f req-b3919e23-a4fb-47fd-94ca-9246c245ab6d service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:31.130762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-a75eaae3-8302-45f6-85c4-81f362e1742f req-b3919e23-a4fb-47fd-94ca-9246c245ab6d service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:31.142000 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-a75eaae3-8302-45f6-85c4-81f362e1742f req-b3919e23-a4fb-47fd-94ca-9246c245ab6d service nova] Creating event network-vif-deleted:88ef4e43-75b6-482c-8852-e8293b84a9ab for instance 08ba9691-685f-444a-9c86-9ac1562acbf0 on hv-cinder-77957 Aug 24 13:45:31.147216 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-a75eaae3-8302-45f6-85c4-81f362e1742f req-b3919e23-a4fb-47fd-94ca-9246c245ab6d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030677 Aug 24 13:45:31.147808 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 416/846] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:45:31.396776 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-9c58978f-0e3b-4024-bb0b-92347e4dba17 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:31.397426 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-9c58978f-0e3b-4024-bb0b-92347e4dba17 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:31.403780 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9c58978f-0e3b-4024-bb0b-92347e4dba17 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:31.404382 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9c58978f-0e3b-4024-bb0b-92347e4dba17 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:31.410863 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9c58978f-0e3b-4024-bb0b-92347e4dba17 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:31.410863 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9c58978f-0e3b-4024-bb0b-92347e4dba17 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:31.410863 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9c58978f-0e3b-4024-bb0b-92347e4dba17 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:31.410863 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9c58978f-0e3b-4024-bb0b-92347e4dba17 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:31.558154 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-9c58978f-0e3b-4024-bb0b-92347e4dba17 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:31.567096 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-9c58978f-0e3b-4024-bb0b-92347e4dba17 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1564 microversion: 2.1 time: 0.174902 Aug 24 13:45:31.567684 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 431/847] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:31 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:31.662636 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-eabf7129-7b23-456b-a02e-bf042a621433 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:31.663232 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-eabf7129-7b23-456b-a02e-bf042a621433 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:31.669818 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eabf7129-7b23-456b-a02e-bf042a621433 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:31.670293 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eabf7129-7b23-456b-a02e-bf042a621433 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:31.670722 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eabf7129-7b23-456b-a02e-bf042a621433 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:31.671403 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eabf7129-7b23-456b-a02e-bf042a621433 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:31.671852 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eabf7129-7b23-456b-a02e-bf042a621433 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:31.672713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eabf7129-7b23-456b-a02e-bf042a621433 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:31.739439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-eabf7129-7b23-456b-a02e-bf042a621433 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:31.747486 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-eabf7129-7b23-456b-a02e-bf042a621433 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1307 microversion: 2.1 time: 0.089148 Aug 24 13:45:31.748602 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 417/848] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:31 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1307 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:31.983280 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-8fcf8e06-c8ef-4ce5-bbc4-4b17868a9c1b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:31.983772 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-8fcf8e06-c8ef-4ce5-bbc4-4b17868a9c1b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:31.990035 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8fcf8e06-c8ef-4ce5-bbc4-4b17868a9c1b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:31.990512 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8fcf8e06-c8ef-4ce5-bbc4-4b17868a9c1b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:31.990942 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8fcf8e06-c8ef-4ce5-bbc4-4b17868a9c1b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:31.991617 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8fcf8e06-c8ef-4ce5-bbc4-4b17868a9c1b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:31.992061 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8fcf8e06-c8ef-4ce5-bbc4-4b17868a9c1b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:31.992550 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8fcf8e06-c8ef-4ce5-bbc4-4b17868a9c1b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:32.007161 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.wsgi [None req-8fcf8e06-c8ef-4ce5-bbc4-4b17868a9c1b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] HTTP exception thrown: Instance 3ad88e6d-b2b8-4049-b987-94022767fa67 could not be found. Aug 24 13:45:32.011091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-8fcf8e06-c8ef-4ce5-bbc4-4b17868a9c1b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Request method failure captured: Aug 24 13:45:32.011091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: DELETE /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 HTTP/1.1 Aug 24 13:45:32.011091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:45:32.011091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:45:32.011091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:45:32.011091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 0 Aug 24 13:45:32.011091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:45:32.011091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:45:32.011091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:45:32.011091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:45:32.011091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBinWm1p0b_H31lzxpPvzbV7rjy3F8Qzyn9V8PX7wwFXRHJCaJ71LLFkZ_Lkt8k4m1f9ymfMSrmW4KTZotPqVtGf-HmA9MGnpTEXSHWlAWKAH6WNjAbNhI-4NP4nK3tGleZkG8cnaBgxLFes9pTCCxx0p3rv03UC4QT5l95RSPxVokdw Aug 24 13:45:32.011091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:45:32.011091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:45:32.011091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:45:32.011091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:45:32.011091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:45:32.011091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:45:32.011091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:45:32.011091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:32.011091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:45:32.011091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:45:32.012879 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:45:32.012879 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:32.012879 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:45:32.012879 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:32.012879 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:45:32.012879 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:45:32.012879 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:45:32.012879 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: ea9d4eafe59c4c8180eece8ec9283e40 Aug 24 13:45:32.012879 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:45:32.012879 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: > Aug 24 13:45:32.012879 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Instance 3ad88e6d-b2b8-4049-b987-94022767fa67 could not be found. Aug 24 13:45:32.012879 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'id': '3ad88e6d-b2b8-4049-b987-94022767fa67'} Aug 24 13:45:32.013798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:45:32.013798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:32.013798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:45:32.013798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:45:32.013798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:45:32.013798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:45:32.013798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:45:32.013798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:45:32.013798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:45:32.013798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:45:32.013798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ad88e6d-b2b8-4049-b987-94022767fa67 could not be found. Aug 24 13:45:32.013798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:32.013798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:32.013798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:32.013798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:32.013798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:32.013798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:32.013798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:45:32.013798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:45:32.013798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:45:32.015230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:45:32.015230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 13:45:32.015230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 13:45:32.015230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 13:45:32.015230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 13:45:32.015230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:45:32.015230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:45:32.015230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:45:32.015230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:45:32.015230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ad88e6d-b2b8-4049-b987-94022767fa67 could not be found. Aug 24 13:45:32.015230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:32.015230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:32.015230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:32.015230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:32.015230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:32.015230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:32.015230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:45:32.015230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:45:32.015230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ad88e6d-b2b8-4049-b987-94022767fa67 could not be found. Aug 24 13:45:32.015230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:32.016666 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-8fcf8e06-c8ef-4ce5-bbc4-4b17868a9c1b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Returning 404 to user: Instance 3ad88e6d-b2b8-4049-b987-94022767fa67 could not be found. {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:45:32.016666 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-8fcf8e06-c8ef-4ce5-bbc4-4b17868a9c1b tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 404 len: 111 microversion: 2.1 time: 0.030722 Aug 24 13:45:32.016666 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 432/849] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:45:31 2022] DELETE /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:45:32.018957 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-d293594b-1df0-4ebd-97e6-ca8d03849ea7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:32.019606 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-d293594b-1df0-4ebd-97e6-ca8d03849ea7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] [instance: 3ad88e6d-b2b8-4049-b987-94022767fa67] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:32.026425 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d293594b-1df0-4ebd-97e6-ca8d03849ea7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:32.026915 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d293594b-1df0-4ebd-97e6-ca8d03849ea7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:32.027356 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d293594b-1df0-4ebd-97e6-ca8d03849ea7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:32.028055 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d293594b-1df0-4ebd-97e6-ca8d03849ea7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:32.028543 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d293594b-1df0-4ebd-97e6-ca8d03849ea7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:32.028974 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d293594b-1df0-4ebd-97e6-ca8d03849ea7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:32.042897 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-d293594b-1df0-4ebd-97e6-ca8d03849ea7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] HTTP exception thrown: Instance 3ad88e6d-b2b8-4049-b987-94022767fa67 could not be found. Aug 24 13:45:32.051315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-d293594b-1df0-4ebd-97e6-ca8d03849ea7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Request method failure captured: Aug 24 13:45:32.051315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 HTTP/1.1 Aug 24 13:45:32.051315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:45:32.051315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:45:32.051315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:45:32.051315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:45:32.051315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:45:32.051315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:45:32.051315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:45:32.051315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:45:32.051315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBinWm1p0b_H31lzxpPvzbV7rjy3F8Qzyn9V8PX7wwFXRHJCaJ71LLFkZ_Lkt8k4m1f9ymfMSrmW4KTZotPqVtGf-HmA9MGnpTEXSHWlAWKAH6WNjAbNhI-4NP4nK3tGleZkG8cnaBgxLFes9pTCCxx0p3rv03UC4QT5l95RSPxVokdw Aug 24 13:45:32.051315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:45:32.051315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:45:32.051315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:45:32.051315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:45:32.051315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:45:32.051315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:45:32.051315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:45:32.051315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:32.051315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:45:32.051315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:45:32.052869 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/019b2e8bdb934d94a25fe4b355e73c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:45:32.052869 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:32.052869 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 019b2e8bdb934d94a25fe4b355e73c68 Aug 24 13:45:32.052869 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166612185 Aug 24 13:45:32.052869 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:45:32.052869 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:45:32.052869 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:45:32.052869 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: ea9d4eafe59c4c8180eece8ec9283e40 Aug 24 13:45:32.052869 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-AttachVolumeNegativeTest-1166612185-project Aug 24 13:45:32.052869 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:45:32.052869 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Instance 3ad88e6d-b2b8-4049-b987-94022767fa67 could not be found. Aug 24 13:45:32.052869 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': '3ad88e6d-b2b8-4049-b987-94022767fa67'} Aug 24 13:45:32.053713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:45:32.053713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:32.053713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:45:32.053713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:45:32.053713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:45:32.053713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:45:32.053713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:45:32.053713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:45:32.053713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:45:32.053713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:45:32.053713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ad88e6d-b2b8-4049-b987-94022767fa67 could not be found. Aug 24 13:45:32.053713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:32.053713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:32.053713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:32.053713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:32.053713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:32.053713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:32.053713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:45:32.053713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:45:32.053713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:45:32.055136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:45:32.055136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:45:32.055136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:45:32.055136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:45:32.055136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:45:32.055136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:45:32.055136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:45:32.055136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ad88e6d-b2b8-4049-b987-94022767fa67 could not be found. Aug 24 13:45:32.055136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:32.055136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:32.055136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:32.055136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:32.055136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:32.055136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:32.055136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:45:32.055136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:45:32.055136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ad88e6d-b2b8-4049-b987-94022767fa67 could not be found. Aug 24 13:45:32.055136 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:32.056577 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-d293594b-1df0-4ebd-97e6-ca8d03849ea7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] Returning 404 to user: Instance 3ad88e6d-b2b8-4049-b987-94022767fa67 could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:45:32.056577 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-d293594b-1df0-4ebd-97e6-ca8d03849ea7 tempest-AttachVolumeNegativeTest-1166612185 tempest-AttachVolumeNegativeTest-1166612185-project] 10.222.0.73 "GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67" status: 404 len: 111 microversion: 2.1 time: 0.031110 Aug 24 13:45:32.056577 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 418/850] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:32 2022] GET /compute/v2.1/servers/3ad88e6d-b2b8-4049-b987-94022767fa67 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:45:32.770941 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-036a7336-a885-4ac8-9627-85e25cd7af21 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:32.771733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-036a7336-a885-4ac8-9627-85e25cd7af21 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:32.778772 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-036a7336-a885-4ac8-9627-85e25cd7af21 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:32.779232 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-036a7336-a885-4ac8-9627-85e25cd7af21 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:32.779660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-036a7336-a885-4ac8-9627-85e25cd7af21 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:32.780414 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-036a7336-a885-4ac8-9627-85e25cd7af21 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:32.780861 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-036a7336-a885-4ac8-9627-85e25cd7af21 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:32.781273 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-036a7336-a885-4ac8-9627-85e25cd7af21 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:32.786408 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:45:32.817278 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-036a7336-a885-4ac8-9627-85e25cd7af21 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:32.817846 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-036a7336-a885-4ac8-9627-85e25cd7af21 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:32.818281 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-036a7336-a885-4ac8-9627-85e25cd7af21 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:32.818831 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.objects.instance [None req-036a7336-a885-4ac8-9627-85e25cd7af21 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lazy-loading 'fault' on Instance uuid 08ba9691-685f-444a-9c86-9ac1562acbf0 {{(pid=133015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:45:32.878526 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-036a7336-a885-4ac8-9627-85e25cd7af21 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb792e7246d42dface4aa52899a0ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127e5da55b164ce68568c153fee58baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:32.886280 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-036a7336-a885-4ac8-9627-85e25cd7af21 tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 200 len: 1312 microversion: 2.1 time: 0.119702 Aug 24 13:45:32.886884 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 433/851] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:32 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 1312 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:33.583929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-2e95054d-eaec-47a2-89d9-54b5565b8296 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:33.589366 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-2e95054d-eaec-47a2-89d9-54b5565b8296 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:33.591384 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2e95054d-eaec-47a2-89d9-54b5565b8296 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:33.591960 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2e95054d-eaec-47a2-89d9-54b5565b8296 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:33.592475 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2e95054d-eaec-47a2-89d9-54b5565b8296 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:33.593258 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2e95054d-eaec-47a2-89d9-54b5565b8296 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:33.593752 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2e95054d-eaec-47a2-89d9-54b5565b8296 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:33.594238 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2e95054d-eaec-47a2-89d9-54b5565b8296 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:33.635633 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-2e95054d-eaec-47a2-89d9-54b5565b8296 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Going to try to terminate instance {{(pid=133014) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 13:45:33.908785 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-fe4339ec-32b1-42a2-a4d5-6738dea9575b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:33.909637 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-fe4339ec-32b1-42a2-a4d5-6738dea9575b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] [instance: 08ba9691-685f-444a-9c86-9ac1562acbf0] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:33.919484 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fe4339ec-32b1-42a2-a4d5-6738dea9575b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:33.919484 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fe4339ec-32b1-42a2-a4d5-6738dea9575b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:33.919484 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fe4339ec-32b1-42a2-a4d5-6738dea9575b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:33.919484 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fe4339ec-32b1-42a2-a4d5-6738dea9575b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:33.920399 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fe4339ec-32b1-42a2-a4d5-6738dea9575b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:33.920509 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fe4339ec-32b1-42a2-a4d5-6738dea9575b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:33.942950 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.wsgi [None req-fe4339ec-32b1-42a2-a4d5-6738dea9575b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] HTTP exception thrown: Instance 08ba9691-685f-444a-9c86-9ac1562acbf0 could not be found. Aug 24 13:45:33.944628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-fe4339ec-32b1-42a2-a4d5-6738dea9575b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Request method failure captured: Aug 24 13:45:33.944628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 HTTP/1.1 Aug 24 13:45:33.944628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:45:33.944628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:45:33.944628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:45:33.944628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 0 Aug 24 13:45:33.944628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:45:33.944628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:45:33.944628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:45:33.944628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:45:33.944628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBio-vt113GyIGAINLSzOWx94ASYzerXaZEv5YREo1TToDpvzKyjcRowpvDgdJaKCc7yo4wyulaPEgIjpHjojWeA6p7mHKzAe5aa4pnmTJ73FsHansramwsQRGoDLdIydz44BXnhPycna7G2wYedVilx-YfOCQ3CHOnMCEUjDFP26dAs Aug 24 13:45:33.944628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:45:33.944628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:45:33.944628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:45:33.944628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:45:33.944628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:45:33.944628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:45:33.944628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: 127e5da55b164ce68568c153fee58baf Aug 24 13:45:33.944628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1606015574 Aug 24 13:45:33.944628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:45:33.944628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:45:33.946631 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/127e5da55b164ce68568c153fee58baf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/127e5da55b164ce68568c153fee58baf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_127e5da55b164ce68568c153fee58baf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/127e5da55b164ce68568c153fee58baf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:45:33.946631 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1606015574 Aug 24 13:45:33.946631 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: 127e5da55b164ce68568c153fee58baf Aug 24 13:45:33.946631 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1606015574 Aug 24 13:45:33.946631 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-ServerRescueNegativeTestJSON-1606015574-project Aug 24 13:45:33.946631 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:45:33.946631 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:45:33.946631 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: adb792e7246d42dface4aa52899a0ffc Aug 24 13:45:33.946631 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1606015574-project Aug 24 13:45:33.946631 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: > Aug 24 13:45:33.946631 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Instance 08ba9691-685f-444a-9c86-9ac1562acbf0 could not be found. Aug 24 13:45:33.946631 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'id': '08ba9691-685f-444a-9c86-9ac1562acbf0'} Aug 24 13:45:33.948128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:45:33.948128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:33.948128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:45:33.948128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:45:33.948128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:45:33.948128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:45:33.948128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:45:33.948128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:45:33.948128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:45:33.948128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:45:33.948128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08ba9691-685f-444a-9c86-9ac1562acbf0 could not be found. Aug 24 13:45:33.948128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:33.948128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:33.948128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:33.948128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:33.948128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:33.948128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:33.948128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:45:33.948128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:45:33.948128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:45:33.954851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:45:33.954851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:45:33.954851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:45:33.954851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:45:33.954851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:45:33.954851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:45:33.954851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:45:33.954851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08ba9691-685f-444a-9c86-9ac1562acbf0 could not be found. Aug 24 13:45:33.954851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:33.954851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:33.954851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:33.954851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:33.954851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:33.954851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:33.954851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:45:33.954851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:45:33.954851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08ba9691-685f-444a-9c86-9ac1562acbf0 could not be found. Aug 24 13:45:33.954851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:33.956618 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-fe4339ec-32b1-42a2-a4d5-6738dea9575b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] Returning 404 to user: Instance 08ba9691-685f-444a-9c86-9ac1562acbf0 could not be found. {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:45:33.956618 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-fe4339ec-32b1-42a2-a4d5-6738dea9575b tempest-ServerRescueNegativeTestJSON-1606015574 tempest-ServerRescueNegativeTestJSON-1606015574-project] 10.222.0.73 "GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0" status: 404 len: 111 microversion: 2.1 time: 0.043360 Aug 24 13:45:33.956618 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 434/852] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:33 2022] GET /compute/v2.1/servers/08ba9691-685f-444a-9c86-9ac1562acbf0 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 13:45:33.968125 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-2e95054d-eaec-47a2-89d9-54b5565b8296 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "DELETE /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 204 len: 0 microversion: 2.1 time: 0.388402 Aug 24 13:45:33.970784 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 419/853] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:45:33 2022] DELETE /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:45:33.978601 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a37338b1-13fa-41be-82e7-64a63ddd775d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:33.979390 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-a37338b1-13fa-41be-82e7-64a63ddd775d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:33.991062 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a37338b1-13fa-41be-82e7-64a63ddd775d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:33.991862 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a37338b1-13fa-41be-82e7-64a63ddd775d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:33.992594 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a37338b1-13fa-41be-82e7-64a63ddd775d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:33.993567 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a37338b1-13fa-41be-82e7-64a63ddd775d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:33.994509 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a37338b1-13fa-41be-82e7-64a63ddd775d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:33.996346 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a37338b1-13fa-41be-82e7-64a63ddd775d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:34.308078 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-a37338b1-13fa-41be-82e7-64a63ddd775d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:34.320249 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a37338b1-13fa-41be-82e7-64a63ddd775d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 200 len: 1575 microversion: 2.1 time: 0.345068 Aug 24 13:45:34.321625 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 435/854] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:33 2022] GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 1575 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:35.349339 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e332952a-e300-4ca4-81fb-32fdd5ab6b54 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:35.351378 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-e332952a-e300-4ca4-81fb-32fdd5ab6b54 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:35.358247 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e332952a-e300-4ca4-81fb-32fdd5ab6b54 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:35.359022 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e332952a-e300-4ca4-81fb-32fdd5ab6b54 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:35.359788 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e332952a-e300-4ca4-81fb-32fdd5ab6b54 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:35.360770 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e332952a-e300-4ca4-81fb-32fdd5ab6b54 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:35.361412 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e332952a-e300-4ca4-81fb-32fdd5ab6b54 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:35.361847 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e332952a-e300-4ca4-81fb-32fdd5ab6b54 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:35.656991 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e332952a-e300-4ca4-81fb-32fdd5ab6b54 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:35.664525 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:45:35.698365 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-e332952a-e300-4ca4-81fb-32fdd5ab6b54 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 200 len: 1575 microversion: 2.1 time: 0.358211 Aug 24 13:45:35.699710 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 420/855] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:35 2022] GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 1575 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:36.722191 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-11aa7b1d-1734-4548-af6d-f581dae14561 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:36.723521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-11aa7b1d-1734-4548-af6d-f581dae14561 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:36.731062 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-11aa7b1d-1734-4548-af6d-f581dae14561 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:36.732821 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-11aa7b1d-1734-4548-af6d-f581dae14561 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:36.741706 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-11aa7b1d-1734-4548-af6d-f581dae14561 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:36.741706 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-11aa7b1d-1734-4548-af6d-f581dae14561 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:36.741706 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-11aa7b1d-1734-4548-af6d-f581dae14561 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:36.741706 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-11aa7b1d-1734-4548-af6d-f581dae14561 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:37.038147 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-11aa7b1d-1734-4548-af6d-f581dae14561 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:37.052527 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-11aa7b1d-1734-4548-af6d-f581dae14561 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 200 len: 1575 microversion: 2.1 time: 0.333344 Aug 24 13:45:37.077802 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 436/856] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:36 2022] GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 1575 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:37.411079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-9a09e9c3-ffc0-4a54-814a-278f5b89710f req-fd709e38-7399-4b42-9493-80379b974c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d89846c9-96d3-4b1b-bba0-bc5d89c6bbde", "name": "network-vif-deleted", "tag": "a8cb0618-6a5e-42d2-b95f-2fbf7a391e9a"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:45:37.422365 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-9a09e9c3-ffc0-4a54-814a-278f5b89710f req-fd709e38-7399-4b42-9493-80379b974c9b service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:37.422845 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-9a09e9c3-ffc0-4a54-814a-278f5b89710f req-fd709e38-7399-4b42-9493-80379b974c9b service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:37.423466 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-9a09e9c3-ffc0-4a54-814a-278f5b89710f req-fd709e38-7399-4b42-9493-80379b974c9b service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:37.438724 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-9a09e9c3-ffc0-4a54-814a-278f5b89710f req-fd709e38-7399-4b42-9493-80379b974c9b service nova] Creating event network-vif-deleted:a8cb0618-6a5e-42d2-b95f-2fbf7a391e9a for instance d89846c9-96d3-4b1b-bba0-bc5d89c6bbde on hv-cinder-77957 Aug 24 13:45:37.445741 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-9a09e9c3-ffc0-4a54-814a-278f5b89710f req-fd709e38-7399-4b42-9493-80379b974c9b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039229 Aug 24 13:45:37.450286 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 421/857] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:45:38.076611 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-4ef48ebf-e9e1-41e6-af86-11946b8173f1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:38.085573 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-4ef48ebf-e9e1-41e6-af86-11946b8173f1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:38.101541 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4ef48ebf-e9e1-41e6-af86-11946b8173f1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:38.102306 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4ef48ebf-e9e1-41e6-af86-11946b8173f1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:38.102857 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4ef48ebf-e9e1-41e6-af86-11946b8173f1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:38.103693 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4ef48ebf-e9e1-41e6-af86-11946b8173f1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:38.104930 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4ef48ebf-e9e1-41e6-af86-11946b8173f1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:38.105869 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4ef48ebf-e9e1-41e6-af86-11946b8173f1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:38.232431 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4ef48ebf-e9e1-41e6-af86-11946b8173f1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:38.241990 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-4ef48ebf-e9e1-41e6-af86-11946b8173f1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 200 len: 1225 microversion: 2.1 time: 0.170488 Aug 24 13:45:38.242935 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 437/858] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:38 2022] GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 1225 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:45:39.268447 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-5a974bb4-8535-4a1d-adcb-def4fa4fb80a tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:39.270565 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-5a974bb4-8535-4a1d-adcb-def4fa4fb80a tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:39.283921 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5a974bb4-8535-4a1d-adcb-def4fa4fb80a tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:39.284471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5a974bb4-8535-4a1d-adcb-def4fa4fb80a tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:39.287739 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5a974bb4-8535-4a1d-adcb-def4fa4fb80a tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:39.287739 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5a974bb4-8535-4a1d-adcb-def4fa4fb80a tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:39.287739 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5a974bb4-8535-4a1d-adcb-def4fa4fb80a tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:39.287739 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5a974bb4-8535-4a1d-adcb-def4fa4fb80a tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:39.304317 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-5a974bb4-8535-4a1d-adcb-def4fa4fb80a tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] HTTP exception thrown: Instance d89846c9-96d3-4b1b-bba0-bc5d89c6bbde could not be found. Aug 24 13:45:39.306066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-5a974bb4-8535-4a1d-adcb-def4fa4fb80a tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Request method failure captured: Aug 24 13:45:39.306066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde HTTP/1.1 Aug 24 13:45:39.306066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:45:39.306066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:45:39.306066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:45:39.306066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:45:39.306066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:45:39.306066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:45:39.306066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:45:39.306066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:45:39.306066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBirDMWGCWz1k-wLH4jMxqbOMpcFxpi9pwRC21qoFMgW36uUY1RFRhNX374Cdq6MopCgngEAN-WHOlQvoIss7pZozQzJnAjbr_L0ar2fl9WpR-0laKP7uWrTHuQMFheygufZre0yv_1n7-aoST62xSq8_4T-n4QlskpVqCb82jkHXFi4 Aug 24 13:45:39.306066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:45:39.306066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:45:39.306066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:45:39.306066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:45:39.306066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:45:39.306066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:45:39.306066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 6842f55d3dcc42289b6bfe02ed020dc4 Aug 24 13:45:39.306066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-TestVolumeBootPattern-1955094951 Aug 24 13:45:39.306066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:45:39.306066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:45:39.307842 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6842f55d3dcc42289b6bfe02ed020dc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6842f55d3dcc42289b6bfe02ed020dc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6842f55d3dcc42289b6bfe02ed020dc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6842f55d3dcc42289b6bfe02ed020dc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:45:39.307842 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-TestVolumeBootPattern-1955094951 Aug 24 13:45:39.307842 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 6842f55d3dcc42289b6bfe02ed020dc4 Aug 24 13:45:39.307842 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-TestVolumeBootPattern-1955094951 Aug 24 13:45:39.307842 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-TestVolumeBootPattern-1955094951-project Aug 24 13:45:39.307842 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:45:39.307842 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:45:39.307842 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: 98b30f0436864263b2829921f212f8ce Aug 24 13:45:39.307842 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-TestVolumeBootPattern-1955094951-project Aug 24 13:45:39.307842 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:45:39.307842 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Instance d89846c9-96d3-4b1b-bba0-bc5d89c6bbde could not be found. Aug 24 13:45:39.307842 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': 'd89846c9-96d3-4b1b-bba0-bc5d89c6bbde'} Aug 24 13:45:39.308726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:45:39.308726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:39.308726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:45:39.308726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:45:39.308726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:45:39.308726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:45:39.308726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:45:39.308726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:45:39.308726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:45:39.308726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:45:39.308726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d89846c9-96d3-4b1b-bba0-bc5d89c6bbde could not be found. Aug 24 13:45:39.308726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:39.308726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:39.308726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:39.308726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:39.308726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:39.308726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:39.308726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:45:39.308726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:45:39.308726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:45:39.310188 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:45:39.310188 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:45:39.310188 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:45:39.310188 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:45:39.310188 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:45:39.310188 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:45:39.310188 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:45:39.310188 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d89846c9-96d3-4b1b-bba0-bc5d89c6bbde could not be found. Aug 24 13:45:39.310188 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:39.310188 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:39.310188 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:39.310188 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:39.310188 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:39.310188 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:39.310188 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:45:39.310188 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:45:39.310188 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d89846c9-96d3-4b1b-bba0-bc5d89c6bbde could not be found. Aug 24 13:45:39.310188 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:39.311434 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-5a974bb4-8535-4a1d-adcb-def4fa4fb80a tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Returning 404 to user: Instance d89846c9-96d3-4b1b-bba0-bc5d89c6bbde could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:45:39.311434 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-5a974bb4-8535-4a1d-adcb-def4fa4fb80a tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 404 len: 111 microversion: 2.1 time: 0.046084 Aug 24 13:45:39.317270 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 422/859] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:39 2022] GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 13:45:39.433410 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-fd1a7768-21f0-4cd1-a839-4c9efeb5b165 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-209508979", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-797259511", "security_groups": [{"name": "tempest-secgroup-smoke-856119561"}], "block_device_mapping_v2": [{"uuid": "5c06e37d-1016-4f82-a553-5d1fa159c3d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "440bd507-b6ac-4736-a4d2-ede05189225c"}]}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:45:39.569894 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.network.neutron [None req-fd1a7768-21f0-4cd1-a839-4c9efeb5b165 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] validate_networks() for [('440bd507-b6ac-4736-a4d2-ede05189225c', None, None, None, None, None)] {{(pid=133015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:45:40.013582 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-fd1a7768-21f0-4cd1-a839-4c9efeb5b165 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Flavor limits 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:45:40.014579 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-fd1a7768-21f0-4cd1-a839-4c9efeb5b165 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Image limits 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:45:40.015107 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-fd1a7768-21f0-4cd1-a839-4c9efeb5b165 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Flavor pref 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:45:40.015763 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-fd1a7768-21f0-4cd1-a839-4c9efeb5b165 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Image pref 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:45:40.016381 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-fd1a7768-21f0-4cd1-a839-4c9efeb5b165 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:45:40.026681 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fd1a7768-21f0-4cd1-a839-4c9efeb5b165 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:40.027230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fd1a7768-21f0-4cd1-a839-4c9efeb5b165 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:40.029627 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fd1a7768-21f0-4cd1-a839-4c9efeb5b165 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:40.029627 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fd1a7768-21f0-4cd1-a839-4c9efeb5b165 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:40.029627 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fd1a7768-21f0-4cd1-a839-4c9efeb5b165 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:40.029627 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fd1a7768-21f0-4cd1-a839-4c9efeb5b165 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:40.049090 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-fd1a7768-21f0-4cd1-a839-4c9efeb5b165 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Getting quotas for project 6842f55d3dcc42289b6bfe02ed020dc4. Resources: {'instances', 'cores', 'ram'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:45:40.054249 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-fd1a7768-21f0-4cd1-a839-4c9efeb5b165 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Getting quotas for user 98b30f0436864263b2829921f212f8ce and project 6842f55d3dcc42289b6bfe02ed020dc4. Resources: {'instances', 'cores', 'ram'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:45:40.120071 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-fd1a7768-21f0-4cd1-a839-4c9efeb5b165 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Going to run 1 instances... {{(pid=133015) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 13:45:40.122249 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-fd1a7768-21f0-4cd1-a839-4c9efeb5b165 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5c06e37d-1016-4f82-a553-5d1fa159c3d8',volume_size=None,volume_type=None)] {{(pid=133015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 13:45:40.665897 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-fd1a7768-21f0-4cd1-a839-4c9efeb5b165 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.240420 Aug 24 13:45:40.666750 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 438/860] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 13:45:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 1242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 13:45:40.680259 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-82a6eafd-7488-43b2-802d-bc0a0efdef93 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:40.681092 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-82a6eafd-7488-43b2-802d-bc0a0efdef93 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:40.762391 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-82a6eafd-7488-43b2-802d-bc0a0efdef93 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:40.779039 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-82a6eafd-7488-43b2-802d-bc0a0efdef93 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6" status: 200 len: 1093 microversion: 2.1 time: 0.104246 Aug 24 13:45:40.780577 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 423/861] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:40 2022] GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 => generated 1093 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:41.413421 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-e8d0587f-f313-41d7-b5e1-219f6e647931 tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] Action: 'create', calling method: .version_select at 0x7f96c21f0b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1762774811", "metadata": {"Type": "work"}}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:45:41.432028 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-e8d0587f-f313-41d7-b5e1-219f6e647931 tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] Request method failure captured: Aug 24 13:45:41.432028 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 13:45:41.432028 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:45:41.432028 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:45:41.432028 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:45:41.432028 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 122 Aug 24 13:45:41.432028 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:45:41.432028 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:45:41.432028 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:45:41.432028 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:45:41.432028 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBiuFcFAAtlXnVjoX4zMozCPeN4jcfM4mQkGmeIalx_xg7djHLB1oG9hIuT8JsRFpS_KHpTgRlznRyZtau02O5o1j7-lJJovyvmv0GtUe3QDO8vd9CWDEJasFGV30SQJzt-SCNsZKyT5PJTxb9bjFpBCZ7BCaaKss7R1BR5nR0ZAcvX4 Aug 24 13:45:41.432028 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:45:41.432028 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:45:41.432028 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:45:41.432028 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:45:41.432028 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:45:41.432028 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:45:41.432028 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: 7e153c49233f415aabe4e6325b945ed6 Aug 24 13:45:41.432028 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-VolumesNegativeTest-1956466327 Aug 24 13:45:41.432028 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:45:41.432028 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:45:41.433739 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7e153c49233f415aabe4e6325b945ed6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7e153c49233f415aabe4e6325b945ed6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_7e153c49233f415aabe4e6325b945ed6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/7e153c49233f415aabe4e6325b945ed6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:45:41.433739 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-VolumesNegativeTest-1956466327 Aug 24 13:45:41.433739 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: 7e153c49233f415aabe4e6325b945ed6 Aug 24 13:45:41.433739 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-VolumesNegativeTest-1956466327 Aug 24 13:45:41.433739 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-VolumesNegativeTest-1956466327-project Aug 24 13:45:41.433739 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:45:41.433739 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:45:41.433739 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: 8523e49705f44fe2b053ebf79d955cb1 Aug 24 13:45:41.433739 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-VolumesNegativeTest-1956466327-project Aug 24 13:45:41.433739 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Aug 24 13:45:41.433739 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1762774811", "metadata": {"Type": "work"}}} Aug 24 13:45:41.433739 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: Aug 24 13:45:41.433739 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 13:45:41.434733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1762774811', 'metadata': {'Type': 'work'}}}} Aug 24 13:45:41.434733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:45:41.434733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:41.434733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 13:45:41.434733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 13:45:41.434733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 13:45:41.434733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise error Aug 24 13:45:41.434733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 13:45:41.434733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.434733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 13:45:41.434733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 13:45:41.434733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.434733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 13:45:41.434733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 13:45:41.434733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.434733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:41.434733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.434733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:41.434733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:41.434733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:41.434733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:45:41.434733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:45:41.436437 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 13:45:41.436437 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 13:45:41.436437 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:45:41.436437 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:45:41.436437 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 13:45:41.436437 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 13:45:41.436437 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 13:45:41.436437 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 13:45:41.436437 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 13:45:41.436437 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 13:45:41.436437 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 13:45:41.436437 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.436437 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:41.436437 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.436437 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:41.436437 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:41.436437 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:41.436437 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 13:45:41.436437 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 13:45:41.437835 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 13:45:41.437835 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.437835 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-e8d0587f-f313-41d7-b5e1-219f6e647931 tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:45:41.437835 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-e8d0587f-f313-41d7-b5e1-219f6e647931 tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.144258 Aug 24 13:45:41.438509 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 439/862] 10.222.0.73 () {60 vars in 1156 bytes} [Wed Aug 24 13:45:41 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 13:45:41.443793 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-2acb30ed-428a-47b1-8ec8-aa0bc1f4a7fc tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] Action: 'create', calling method: .version_select at 0x7f96c212faf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-593446723", "metadata": {"Type": "work"}}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:45:41.448958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-2acb30ed-428a-47b1-8ec8-aa0bc1f4a7fc tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] Request method failure captured: Aug 24 13:45:41.448958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 13:45:41.448958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:45:41.448958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:45:41.448958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:45:41.448958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 119 Aug 24 13:45:41.448958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:45:41.448958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:45:41.448958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:45:41.448958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:45:41.448958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBiuFcFAAtlXnVjoX4zMozCPeN4jcfM4mQkGmeIalx_xg7djHLB1oG9hIuT8JsRFpS_KHpTgRlznRyZtau02O5o1j7-lJJovyvmv0GtUe3QDO8vd9CWDEJasFGV30SQJzt-SCNsZKyT5PJTxb9bjFpBCZ7BCaaKss7R1BR5nR0ZAcvX4 Aug 24 13:45:41.448958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:45:41.448958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:45:41.448958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:45:41.448958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:45:41.448958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:45:41.448958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:45:41.448958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 7e153c49233f415aabe4e6325b945ed6 Aug 24 13:45:41.448958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-VolumesNegativeTest-1956466327 Aug 24 13:45:41.448958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:45:41.448958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:45:41.450663 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7e153c49233f415aabe4e6325b945ed6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7e153c49233f415aabe4e6325b945ed6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_7e153c49233f415aabe4e6325b945ed6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/7e153c49233f415aabe4e6325b945ed6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:45:41.450663 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-VolumesNegativeTest-1956466327 Aug 24 13:45:41.450663 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 7e153c49233f415aabe4e6325b945ed6 Aug 24 13:45:41.450663 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-VolumesNegativeTest-1956466327 Aug 24 13:45:41.450663 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-VolumesNegativeTest-1956466327-project Aug 24 13:45:41.450663 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:45:41.450663 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:45:41.450663 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: 8523e49705f44fe2b053ebf79d955cb1 Aug 24 13:45:41.450663 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-VolumesNegativeTest-1956466327-project Aug 24 13:45:41.450663 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Aug 24 13:45:41.450663 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-593446723", "metadata": {"Type": "work"}}} Aug 24 13:45:41.450663 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: Aug 24 13:45:41.450663 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 13:45:41.451556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-593446723', 'metadata': {'Type': 'work'}}}} Aug 24 13:45:41.451556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:45:41.451556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:41.451556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 13:45:41.451556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 13:45:41.451556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 13:45:41.451556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise error Aug 24 13:45:41.451556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 13:45:41.451556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.451556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 13:45:41.451556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 13:45:41.451556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.451556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 13:45:41.451556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi '0' Aug 24 13:45:41.451556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.451556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:41.451556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.451556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:41.451556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:41.451556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:41.451556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:45:41.451556 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:45:41.453275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 13:45:41.453275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 13:45:41.453275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:45:41.453275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:45:41.453275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 13:45:41.453275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 13:45:41.453275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 13:45:41.453275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 13:45:41.453275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 13:45:41.453275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 13:45:41.453275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 13:45:41.453275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.453275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:41.453275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.453275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:41.453275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:41.453275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:41.453275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 13:45:41.453275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 13:45:41.454759 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 13:45:41.454759 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.454759 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-2acb30ed-428a-47b1-8ec8-aa0bc1f4a7fc tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:45:41.454759 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-2acb30ed-428a-47b1-8ec8-aa0bc1f4a7fc tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011351 Aug 24 13:45:41.454759 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 424/863] 10.222.0.73 () {60 vars in 1156 bytes} [Wed Aug 24 13:45:41 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 13:45:41.463995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a1dbb47b-06ab-4c88-8cd7-8ac1866e1c0f tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] Action: 'create', calling method: .version_select at 0x7f96c1fc2ca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-469302004", "metadata": {"Type": "work"}}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:45:41.467670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a1dbb47b-06ab-4c88-8cd7-8ac1866e1c0f tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] Request method failure captured: Aug 24 13:45:41.467670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 13:45:41.467670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:45:41.467670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:45:41.467670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:45:41.467670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 118 Aug 24 13:45:41.467670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:45:41.467670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:45:41.467670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:45:41.467670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:45:41.467670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBiuFcFAAtlXnVjoX4zMozCPeN4jcfM4mQkGmeIalx_xg7djHLB1oG9hIuT8JsRFpS_KHpTgRlznRyZtau02O5o1j7-lJJovyvmv0GtUe3QDO8vd9CWDEJasFGV30SQJzt-SCNsZKyT5PJTxb9bjFpBCZ7BCaaKss7R1BR5nR0ZAcvX4 Aug 24 13:45:41.467670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:45:41.467670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:45:41.467670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:45:41.467670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:45:41.467670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:45:41.467670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:45:41.467670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: 7e153c49233f415aabe4e6325b945ed6 Aug 24 13:45:41.467670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-VolumesNegativeTest-1956466327 Aug 24 13:45:41.467670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:45:41.467670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:45:41.469188 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7e153c49233f415aabe4e6325b945ed6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7e153c49233f415aabe4e6325b945ed6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_7e153c49233f415aabe4e6325b945ed6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/7e153c49233f415aabe4e6325b945ed6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:45:41.469188 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-VolumesNegativeTest-1956466327 Aug 24 13:45:41.469188 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: 7e153c49233f415aabe4e6325b945ed6 Aug 24 13:45:41.469188 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-VolumesNegativeTest-1956466327 Aug 24 13:45:41.469188 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-VolumesNegativeTest-1956466327-project Aug 24 13:45:41.469188 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:45:41.469188 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:45:41.469188 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: 8523e49705f44fe2b053ebf79d955cb1 Aug 24 13:45:41.469188 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-VolumesNegativeTest-1956466327-project Aug 24 13:45:41.469188 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Aug 24 13:45:41.469188 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-469302004", "metadata": {"Type": "work"}}} Aug 24 13:45:41.469188 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: Aug 24 13:45:41.469188 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 13:45:41.470089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-469302004', 'metadata': {'Type': 'work'}}}} Aug 24 13:45:41.470089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:45:41.470089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:41.470089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 13:45:41.470089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 13:45:41.470089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 13:45:41.470089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise error Aug 24 13:45:41.470089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 13:45:41.470089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.470089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 13:45:41.470089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 13:45:41.470089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.470089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 13:45:41.470089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi '' Aug 24 13:45:41.470089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.470089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:41.470089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.470089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:41.470089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:41.470089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:41.470089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:45:41.470089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:45:41.471446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 13:45:41.471446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 13:45:41.471446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:45:41.471446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:45:41.471446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 13:45:41.471446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 13:45:41.471446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 13:45:41.471446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 13:45:41.471446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 13:45:41.471446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 13:45:41.471446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 13:45:41.471446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.471446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:41.471446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.471446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:41.471446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:41.471446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:41.471446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 13:45:41.471446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 13:45:41.472585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 13:45:41.472585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.472585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a1dbb47b-06ab-4c88-8cd7-8ac1866e1c0f tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:45:41.472585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a1dbb47b-06ab-4c88-8cd7-8ac1866e1c0f tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010451 Aug 24 13:45:41.472585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 440/864] 10.222.0.73 () {60 vars in 1156 bytes} [Wed Aug 24 13:45:41 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 13:45:41.480583 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e01d4015-b615-432a-b9d8-753ede37c8d0 tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] Calling method '.version_select at 0x7f96c2152b80>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:41.509415 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-e01d4015-b615-432a-b9d8-753ede37c8d0 tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] HTTP exception thrown: Volume tempest-invalid-829239980 could not be found. Aug 24 13:45:41.511388 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e01d4015-b615-432a-b9d8-753ede37c8d0 tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] Request method failure captured: Aug 24 13:45:41.511388 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-829239980 HTTP/1.1 Aug 24 13:45:41.511388 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:45:41.511388 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:45:41.511388 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:45:41.511388 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:45:41.511388 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:45:41.511388 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:45:41.511388 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:45:41.511388 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:45:41.511388 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBiuFcFAAtlXnVjoX4zMozCPeN4jcfM4mQkGmeIalx_xg7djHLB1oG9hIuT8JsRFpS_KHpTgRlznRyZtau02O5o1j7-lJJovyvmv0GtUe3QDO8vd9CWDEJasFGV30SQJzt-SCNsZKyT5PJTxb9bjFpBCZ7BCaaKss7R1BR5nR0ZAcvX4 Aug 24 13:45:41.511388 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:45:41.511388 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:45:41.511388 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:45:41.511388 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:45:41.511388 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:45:41.511388 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:45:41.511388 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 7e153c49233f415aabe4e6325b945ed6 Aug 24 13:45:41.511388 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-VolumesNegativeTest-1956466327 Aug 24 13:45:41.511388 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:45:41.511388 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:45:41.512986 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7e153c49233f415aabe4e6325b945ed6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7e153c49233f415aabe4e6325b945ed6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_7e153c49233f415aabe4e6325b945ed6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/7e153c49233f415aabe4e6325b945ed6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:45:41.512986 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-VolumesNegativeTest-1956466327 Aug 24 13:45:41.512986 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 7e153c49233f415aabe4e6325b945ed6 Aug 24 13:45:41.512986 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-VolumesNegativeTest-1956466327 Aug 24 13:45:41.512986 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-VolumesNegativeTest-1956466327-project Aug 24 13:45:41.512986 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:45:41.512986 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:45:41.512986 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: 8523e49705f44fe2b053ebf79d955cb1 Aug 24 13:45:41.512986 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-VolumesNegativeTest-1956466327-project Aug 24 13:45:41.512986 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: Aug 24 13:45:41.512986 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Volume tempest-invalid-829239980 could not be found. Aug 24 13:45:41.512986 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': 'tempest-invalid-829239980'} Aug 24 13:45:41.512986 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:45:41.513864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:41.513864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 13:45:41.513864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 13:45:41.513864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 13:45:41.513864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 13:45:41.513864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 13:45:41.513864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 13:45:41.513864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 13:45:41.513864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 13:45:41.513864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 13:45:41.513864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 13:45:41.513864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 13:45:41.513864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 13:45:41.513864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 13:45:41.513864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 13:45:41.513864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-829239980 could not be found. (HTTP 404) (Request-ID: req-f4aecc0c-27bb-4433-9fc0-748bf1201d31) Aug 24 13:45:41.513864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.513864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:41.513864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.515367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:41.515367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 13:45:41.515367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 13:45:41.515367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 13:45:41.515367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 13:45:41.515367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 13:45:41.515367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 13:45:41.515367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 13:45:41.515367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 13:45:41.515367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 13:45:41.515367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 13:45:41.515367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 13:45:41.515367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 13:45:41.515367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 13:45:41.515367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 13:45:41.515367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 13:45:41.515367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 13:45:41.515367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 13:45:41.515367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 13:45:41.518223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 13:45:41.518223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 13:45:41.518223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 13:45:41.518223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 13:45:41.518223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-829239980 could not be found. Aug 24 13:45:41.518223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.518223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:41.518223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.518223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:41.518223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:41.518223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:41.518223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:45:41.518223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:45:41.518223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 13:45:41.518223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 13:45:41.518223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:45:41.518223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:45:41.518223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 13:45:41.518223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:45:41.518223 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-829239980 could not be found. Aug 24 13:45:41.520369 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.520369 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:41.520369 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.520369 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:41.520369 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:41.520369 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:41.520369 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:45:41.520369 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:45:41.520369 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-829239980 could not be found. Aug 24 13:45:41.520369 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.520369 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e01d4015-b615-432a-b9d8-753ede37c8d0 tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] Returning 404 to user: Volume tempest-invalid-829239980 could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:45:41.520369 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-e01d4015-b615-432a-b9d8-753ede37c8d0 tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/tempest-invalid-829239980" status: 404 len: 98 microversion: 2.1 time: 0.037188 Aug 24 13:45:41.520369 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 425/865] 10.222.0.73 () {58 vars in 1215 bytes} [Wed Aug 24 13:45:41 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-829239980 => generated 98 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 13:45:41.523910 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-bea454c9-d41f-4a18-ae7f-9d7af1de51f3 tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004790 Aug 24 13:45:41.524456 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 441/866] 10.222.0.73 () {58 vars in 1140 bytes} [Wed Aug 24 13:45:41 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 13:45:41.533205 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-352fc02e-cca8-4f67-823a-e4300812b9d5 tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003751 Aug 24 13:45:41.533692 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 426/867] 10.222.0.73 () {58 vars in 1137 bytes} [Wed Aug 24 13:45:41 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 24 13:45:41.543124 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a4419090-b56d-4405-8381-e776ab7ffed8 tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] Calling method '.version_select at 0x7f96c20d33a0>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:41.572946 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.wsgi [None req-a4419090-b56d-4405-8381-e776ab7ffed8 tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] HTTP exception thrown: Volume 7005d236-9b08-40cf-88e9-66ea792c8470 could not be found. Aug 24 13:45:41.575020 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a4419090-b56d-4405-8381-e776ab7ffed8 tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] Request method failure captured: Aug 24 13:45:41.575020 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: DELETE /compute/v2.1/os-volumes/7005d236-9b08-40cf-88e9-66ea792c8470 HTTP/1.1 Aug 24 13:45:41.575020 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:45:41.575020 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:45:41.575020 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:45:41.575020 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 0 Aug 24 13:45:41.575020 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:45:41.575020 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:45:41.575020 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:45:41.575020 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:45:41.575020 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBiuFcFAAtlXnVjoX4zMozCPeN4jcfM4mQkGmeIalx_xg7djHLB1oG9hIuT8JsRFpS_KHpTgRlznRyZtau02O5o1j7-lJJovyvmv0GtUe3QDO8vd9CWDEJasFGV30SQJzt-SCNsZKyT5PJTxb9bjFpBCZ7BCaaKss7R1BR5nR0ZAcvX4 Aug 24 13:45:41.575020 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:45:41.575020 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:45:41.575020 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:45:41.575020 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:45:41.575020 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:45:41.575020 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:45:41.575020 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: 7e153c49233f415aabe4e6325b945ed6 Aug 24 13:45:41.575020 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-VolumesNegativeTest-1956466327 Aug 24 13:45:41.575020 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:45:41.575020 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:45:41.576632 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7e153c49233f415aabe4e6325b945ed6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7e153c49233f415aabe4e6325b945ed6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_7e153c49233f415aabe4e6325b945ed6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/7e153c49233f415aabe4e6325b945ed6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:45:41.576632 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-VolumesNegativeTest-1956466327 Aug 24 13:45:41.576632 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: 7e153c49233f415aabe4e6325b945ed6 Aug 24 13:45:41.576632 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-VolumesNegativeTest-1956466327 Aug 24 13:45:41.576632 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-VolumesNegativeTest-1956466327-project Aug 24 13:45:41.576632 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:45:41.576632 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:45:41.576632 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: 8523e49705f44fe2b053ebf79d955cb1 Aug 24 13:45:41.576632 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-VolumesNegativeTest-1956466327-project Aug 24 13:45:41.576632 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: Aug 24 13:45:41.576632 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Volume 7005d236-9b08-40cf-88e9-66ea792c8470 could not be found. Aug 24 13:45:41.576632 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'id': '7005d236-9b08-40cf-88e9-66ea792c8470'} Aug 24 13:45:41.576632 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:45:41.577564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:41.577564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 13:45:41.577564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 13:45:41.577564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 13:45:41.577564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 13:45:41.577564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 13:45:41.577564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 13:45:41.577564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 13:45:41.577564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 13:45:41.577564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 13:45:41.577564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 13:45:41.577564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 13:45:41.577564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 13:45:41.577564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 13:45:41.577564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 13:45:41.577564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7005d236-9b08-40cf-88e9-66ea792c8470 could not be found. (HTTP 404) (Request-ID: req-062c4cbc-60ee-4603-b220-0ffe3706b329) Aug 24 13:45:41.577564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.577564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:41.577564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.578999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:41.578999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 13:45:41.578999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 13:45:41.578999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 13:45:41.578999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 13:45:41.578999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 13:45:41.578999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 13:45:41.578999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 13:45:41.578999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 13:45:41.578999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 13:45:41.578999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 13:45:41.578999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 13:45:41.578999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 13:45:41.578999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 13:45:41.578999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 13:45:41.578999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 13:45:41.578999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 13:45:41.578999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 13:45:41.578999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 13:45:41.580678 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 13:45:41.580678 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 13:45:41.580678 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 13:45:41.580678 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 13:45:41.580678 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7005d236-9b08-40cf-88e9-66ea792c8470 could not be found. Aug 24 13:45:41.580678 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.580678 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:41.580678 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.580678 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:41.580678 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:41.580678 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:41.580678 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:45:41.580678 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:45:41.580678 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 13:45:41.580678 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 13:45:41.580678 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:45:41.580678 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:45:41.580678 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 13:45:41.580678 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:45:41.584383 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7005d236-9b08-40cf-88e9-66ea792c8470 could not be found. Aug 24 13:45:41.584383 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.584383 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:41.584383 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.584383 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:41.584383 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:41.584383 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:41.584383 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:45:41.584383 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:45:41.584383 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7005d236-9b08-40cf-88e9-66ea792c8470 could not be found. Aug 24 13:45:41.584383 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.584383 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a4419090-b56d-4405-8381-e776ab7ffed8 tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] Returning 404 to user: Volume 7005d236-9b08-40cf-88e9-66ea792c8470 could not be found. {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:45:41.584383 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a4419090-b56d-4405-8381-e776ab7ffed8 tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/7005d236-9b08-40cf-88e9-66ea792c8470" status: 404 len: 109 microversion: 2.1 time: 0.037144 Aug 24 13:45:41.584383 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 442/868] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 13:45:41 2022] DELETE /compute/v2.1/os-volumes/7005d236-9b08-40cf-88e9-66ea792c8470 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:45:41.587260 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-c640099a-9096-4529-9ce1-9e4d42b65c03 tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] Calling method '.version_select at 0x7f96c212fc10>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:41.614577 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-c640099a-9096-4529-9ce1-9e4d42b65c03 tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] HTTP exception thrown: Volume a82680cc-d97d-4296-b181-29d4d94ab591 could not be found. Aug 24 13:45:41.617066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-c640099a-9096-4529-9ce1-9e4d42b65c03 tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] Request method failure captured: Aug 24 13:45:41.617066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: GET /compute/v2.1/os-volumes/a82680cc-d97d-4296-b181-29d4d94ab591 HTTP/1.1 Aug 24 13:45:41.617066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:45:41.617066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:45:41.617066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:45:41.617066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:45:41.617066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:45:41.617066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:45:41.617066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:45:41.617066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:45:41.617066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBiuFcFAAtlXnVjoX4zMozCPeN4jcfM4mQkGmeIalx_xg7djHLB1oG9hIuT8JsRFpS_KHpTgRlznRyZtau02O5o1j7-lJJovyvmv0GtUe3QDO8vd9CWDEJasFGV30SQJzt-SCNsZKyT5PJTxb9bjFpBCZ7BCaaKss7R1BR5nR0ZAcvX4 Aug 24 13:45:41.617066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:45:41.617066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:45:41.617066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:45:41.617066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:45:41.617066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:45:41.617066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:45:41.617066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 7e153c49233f415aabe4e6325b945ed6 Aug 24 13:45:41.617066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-VolumesNegativeTest-1956466327 Aug 24 13:45:41.617066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:45:41.617066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:45:41.618658 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7e153c49233f415aabe4e6325b945ed6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7e153c49233f415aabe4e6325b945ed6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_7e153c49233f415aabe4e6325b945ed6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/7e153c49233f415aabe4e6325b945ed6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:45:41.618658 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-VolumesNegativeTest-1956466327 Aug 24 13:45:41.618658 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 7e153c49233f415aabe4e6325b945ed6 Aug 24 13:45:41.618658 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-VolumesNegativeTest-1956466327 Aug 24 13:45:41.618658 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-VolumesNegativeTest-1956466327-project Aug 24 13:45:41.618658 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:45:41.618658 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:45:41.618658 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: 8523e49705f44fe2b053ebf79d955cb1 Aug 24 13:45:41.618658 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-VolumesNegativeTest-1956466327-project Aug 24 13:45:41.618658 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: Aug 24 13:45:41.618658 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Volume a82680cc-d97d-4296-b181-29d4d94ab591 could not be found. Aug 24 13:45:41.618658 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': 'a82680cc-d97d-4296-b181-29d4d94ab591'} Aug 24 13:45:41.618658 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:45:41.619868 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:41.619868 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 13:45:41.619868 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 13:45:41.619868 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 13:45:41.619868 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 13:45:41.619868 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 13:45:41.619868 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 13:45:41.619868 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 13:45:41.619868 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 13:45:41.619868 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 13:45:41.619868 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 13:45:41.619868 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 13:45:41.619868 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 13:45:41.619868 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 13:45:41.619868 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 13:45:41.619868 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a82680cc-d97d-4296-b181-29d4d94ab591 could not be found. (HTTP 404) (Request-ID: req-8b9c3d72-9577-4f62-9a8b-77b80166d72f) Aug 24 13:45:41.619868 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.619868 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:41.619868 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.621243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:41.621243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 13:45:41.621243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 13:45:41.621243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 13:45:41.621243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 13:45:41.621243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 13:45:41.621243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 13:45:41.621243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 13:45:41.621243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 13:45:41.621243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 13:45:41.621243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 13:45:41.621243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 13:45:41.621243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 13:45:41.621243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 13:45:41.621243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 13:45:41.621243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 13:45:41.621243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 13:45:41.621243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 13:45:41.621243 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 13:45:41.622608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 13:45:41.622608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 13:45:41.622608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 13:45:41.622608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 13:45:41.622608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a82680cc-d97d-4296-b181-29d4d94ab591 could not be found. Aug 24 13:45:41.622608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.622608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:41.622608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.622608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:41.622608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:41.622608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:41.622608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:45:41.622608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:45:41.622608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 13:45:41.622608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 13:45:41.622608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:45:41.622608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:45:41.622608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 13:45:41.622608 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:45:41.623970 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a82680cc-d97d-4296-b181-29d4d94ab591 could not be found. Aug 24 13:45:41.623970 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.623970 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:41.623970 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.623970 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:41.623970 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:41.623970 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:41.623970 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:45:41.623970 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:45:41.623970 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a82680cc-d97d-4296-b181-29d4d94ab591 could not be found. Aug 24 13:45:41.623970 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:41.623970 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-c640099a-9096-4529-9ce1-9e4d42b65c03 tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] Returning 404 to user: Volume a82680cc-d97d-4296-b181-29d4d94ab591 could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:45:41.623970 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-c640099a-9096-4529-9ce1-9e4d42b65c03 tempest-VolumesNegativeTest-1956466327 tempest-VolumesNegativeTest-1956466327-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/a82680cc-d97d-4296-b181-29d4d94ab591" status: 404 len: 109 microversion: 2.1 time: 0.036213 Aug 24 13:45:41.623970 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 427/869] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 13:45:41 2022] GET /compute/v2.1/os-volumes/a82680cc-d97d-4296-b181-29d4d94ab591 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:45:41.802298 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-96e663cc-78ab-4662-8d05-2cfc9be6d896 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:41.803100 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-96e663cc-78ab-4662-8d05-2cfc9be6d896 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:41.818751 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-96e663cc-78ab-4662-8d05-2cfc9be6d896 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:41.819259 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-96e663cc-78ab-4662-8d05-2cfc9be6d896 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:41.819746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-96e663cc-78ab-4662-8d05-2cfc9be6d896 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:41.820548 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-96e663cc-78ab-4662-8d05-2cfc9be6d896 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:41.820974 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-96e663cc-78ab-4662-8d05-2cfc9be6d896 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:41.821399 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-96e663cc-78ab-4662-8d05-2cfc9be6d896 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:41.929024 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-96e663cc-78ab-4662-8d05-2cfc9be6d896 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:41.937004 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-96e663cc-78ab-4662-8d05-2cfc9be6d896 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6" status: 200 len: 1143 microversion: 2.1 time: 0.138995 Aug 24 13:45:41.937575 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 443/870] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:41 2022] GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 => generated 1143 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:42.959902 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-bff7dd1a-9987-4af3-aa2c-b0e9a4fc25de tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:42.960579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-bff7dd1a-9987-4af3-aa2c-b0e9a4fc25de tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:42.966761 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bff7dd1a-9987-4af3-aa2c-b0e9a4fc25de tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:42.967603 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bff7dd1a-9987-4af3-aa2c-b0e9a4fc25de tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:42.968041 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bff7dd1a-9987-4af3-aa2c-b0e9a4fc25de tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:42.969066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bff7dd1a-9987-4af3-aa2c-b0e9a4fc25de tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:42.969530 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bff7dd1a-9987-4af3-aa2c-b0e9a4fc25de tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:42.970081 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bff7dd1a-9987-4af3-aa2c-b0e9a4fc25de tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:43.044376 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-bff7dd1a-9987-4af3-aa2c-b0e9a4fc25de tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:43.053830 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-bff7dd1a-9987-4af3-aa2c-b0e9a4fc25de tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6" status: 200 len: 1191 microversion: 2.1 time: 0.097766 Aug 24 13:45:43.053830 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 428/871] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:42 2022] GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 => generated 1191 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:44.072944 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-5406b305-4cb8-4649-8d26-dc989f47c71d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:44.073563 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-5406b305-4cb8-4649-8d26-dc989f47c71d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:44.077032 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:45:44.080638 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5406b305-4cb8-4649-8d26-dc989f47c71d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:44.081123 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5406b305-4cb8-4649-8d26-dc989f47c71d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:44.081560 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5406b305-4cb8-4649-8d26-dc989f47c71d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:44.082997 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5406b305-4cb8-4649-8d26-dc989f47c71d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:44.083461 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5406b305-4cb8-4649-8d26-dc989f47c71d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:44.083902 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5406b305-4cb8-4649-8d26-dc989f47c71d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:44.265948 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-5406b305-4cb8-4649-8d26-dc989f47c71d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:44.271929 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-5406b305-4cb8-4649-8d26-dc989f47c71d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6" status: 200 len: 1276 microversion: 2.1 time: 0.202721 Aug 24 13:45:44.273452 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 444/872] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:44 2022] GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 => generated 1276 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:45.244399 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-c5ec0cc7-d9a9-46cb-8783-78cca41b9272 req-6a39dbb7-5a0b-471d-acf6-ac2f1de808c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dba10a5-24cb-4641-914e-7558614f82a6", "tag": "ec946f8f-f434-42c3-90a3-60ce66ddf0c3"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:45:45.255789 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-c5ec0cc7-d9a9-46cb-8783-78cca41b9272 req-6a39dbb7-5a0b-471d-acf6-ac2f1de808c1 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:45.256448 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-c5ec0cc7-d9a9-46cb-8783-78cca41b9272 req-6a39dbb7-5a0b-471d-acf6-ac2f1de808c1 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:45.256998 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-c5ec0cc7-d9a9-46cb-8783-78cca41b9272 req-6a39dbb7-5a0b-471d-acf6-ac2f1de808c1 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:45.268351 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-c5ec0cc7-d9a9-46cb-8783-78cca41b9272 req-6a39dbb7-5a0b-471d-acf6-ac2f1de808c1 service nova] Creating event network-changed:ec946f8f-f434-42c3-90a3-60ce66ddf0c3 for instance 1dba10a5-24cb-4641-914e-7558614f82a6 on hv-cinder-77957 Aug 24 13:45:45.274011 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-c5ec0cc7-d9a9-46cb-8783-78cca41b9272 req-6a39dbb7-5a0b-471d-acf6-ac2f1de808c1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033268 Aug 24 13:45:45.274678 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 429/873] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:45:45.296520 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d3d2e326-bac3-4e32-bdc0-94c349ad12db tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:45.300228 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-d3d2e326-bac3-4e32-bdc0-94c349ad12db tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:45.304235 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d3d2e326-bac3-4e32-bdc0-94c349ad12db tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:45.304723 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d3d2e326-bac3-4e32-bdc0-94c349ad12db tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:45.305159 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d3d2e326-bac3-4e32-bdc0-94c349ad12db tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:45.305847 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d3d2e326-bac3-4e32-bdc0-94c349ad12db tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:45.306394 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d3d2e326-bac3-4e32-bdc0-94c349ad12db tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:45.306821 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d3d2e326-bac3-4e32-bdc0-94c349ad12db tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:45.462408 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d3d2e326-bac3-4e32-bdc0-94c349ad12db tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:45.470490 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-d3d2e326-bac3-4e32-bdc0-94c349ad12db tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6" status: 200 len: 1276 microversion: 2.1 time: 0.178437 Aug 24 13:45:45.471067 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 445/874] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:45 2022] GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 => generated 1276 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:46.492682 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-7dcae81b-9d7f-448e-a626-5de13678e681 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:46.493392 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-7dcae81b-9d7f-448e-a626-5de13678e681 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:46.500395 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7dcae81b-9d7f-448e-a626-5de13678e681 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:46.500885 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7dcae81b-9d7f-448e-a626-5de13678e681 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:46.501329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7dcae81b-9d7f-448e-a626-5de13678e681 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:46.502066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7dcae81b-9d7f-448e-a626-5de13678e681 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:46.502494 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7dcae81b-9d7f-448e-a626-5de13678e681 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:46.502923 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7dcae81b-9d7f-448e-a626-5de13678e681 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:46.647465 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-7dcae81b-9d7f-448e-a626-5de13678e681 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:46.655511 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-7dcae81b-9d7f-448e-a626-5de13678e681 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6" status: 200 len: 1264 microversion: 2.1 time: 0.168442 Aug 24 13:45:46.656758 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 430/875] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:46 2022] GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:47.676438 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-c2dc193d-976e-471b-bfd0-5d0631bb5f1c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:47.677031 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-c2dc193d-976e-471b-bfd0-5d0631bb5f1c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:47.683877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c2dc193d-976e-471b-bfd0-5d0631bb5f1c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:47.684395 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c2dc193d-976e-471b-bfd0-5d0631bb5f1c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:47.684833 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c2dc193d-976e-471b-bfd0-5d0631bb5f1c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:47.685525 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c2dc193d-976e-471b-bfd0-5d0631bb5f1c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:47.685980 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c2dc193d-976e-471b-bfd0-5d0631bb5f1c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:47.686405 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c2dc193d-976e-471b-bfd0-5d0631bb5f1c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:47.992457 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c2dc193d-976e-471b-bfd0-5d0631bb5f1c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:48.000450 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-c2dc193d-976e-471b-bfd0-5d0631bb5f1c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6" status: 200 len: 1264 microversion: 2.1 time: 0.328121 Aug 24 13:45:48.001034 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 446/876] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:47 2022] GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 => generated 1264 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:45:48.948679 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-eb2ecd5a-1ac2-4eac-b6d9-6d52cf97b0e7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:48.950854 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-eb2ecd5a-1ac2-4eac-b6d9-6d52cf97b0e7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:48.953741 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:45:48.959260 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eb2ecd5a-1ac2-4eac-b6d9-6d52cf97b0e7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:48.959840 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eb2ecd5a-1ac2-4eac-b6d9-6d52cf97b0e7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:48.960431 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eb2ecd5a-1ac2-4eac-b6d9-6d52cf97b0e7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:48.961174 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eb2ecd5a-1ac2-4eac-b6d9-6d52cf97b0e7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:48.961612 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eb2ecd5a-1ac2-4eac-b6d9-6d52cf97b0e7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:48.962264 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-eb2ecd5a-1ac2-4eac-b6d9-6d52cf97b0e7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:48.994493 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-eb2ecd5a-1ac2-4eac-b6d9-6d52cf97b0e7 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050496 Aug 24 13:45:48.998713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 431/877] 10.222.0.73 () {60 vars in 1343 bytes} [Wed Aug 24 13:45:48 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:49.022330 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-c7b1ffda-cf72-41b3-aa54-8cad62294474 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:49.023040 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-c7b1ffda-cf72-41b3-aa54-8cad62294474 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:49.029555 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c7b1ffda-cf72-41b3-aa54-8cad62294474 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:49.030232 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c7b1ffda-cf72-41b3-aa54-8cad62294474 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:49.030721 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c7b1ffda-cf72-41b3-aa54-8cad62294474 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:49.031418 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c7b1ffda-cf72-41b3-aa54-8cad62294474 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:49.031873 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c7b1ffda-cf72-41b3-aa54-8cad62294474 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:49.032421 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c7b1ffda-cf72-41b3-aa54-8cad62294474 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:49.062989 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-bbc2af33-9741-4ad3-953d-45bfb82f3a4c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:49.063582 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-bbc2af33-9741-4ad3-953d-45bfb82f3a4c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:49.070937 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bbc2af33-9741-4ad3-953d-45bfb82f3a4c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:49.071426 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bbc2af33-9741-4ad3-953d-45bfb82f3a4c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:49.072152 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bbc2af33-9741-4ad3-953d-45bfb82f3a4c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:49.072590 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bbc2af33-9741-4ad3-953d-45bfb82f3a4c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:49.073039 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bbc2af33-9741-4ad3-953d-45bfb82f3a4c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:49.073634 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bbc2af33-9741-4ad3-953d-45bfb82f3a4c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:49.099924 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-bbc2af33-9741-4ad3-953d-45bfb82f3a4c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Going to try to terminate instance {{(pid=133014) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 13:45:49.177041 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c7b1ffda-cf72-41b3-aa54-8cad62294474 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:49.185299 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-c7b1ffda-cf72-41b3-aa54-8cad62294474 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6" status: 200 len: 1264 microversion: 2.1 time: 0.166736 Aug 24 13:45:49.185902 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 447/878] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:49 2022] GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:49.388970 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-bbc2af33-9741-4ad3-953d-45bfb82f3a4c tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 204 len: 0 microversion: 2.20 time: 0.329563 Aug 24 13:45:49.389705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 432/879] 10.222.0.73 () {60 vars in 1280 bytes} [Wed Aug 24 13:45:49 2022] DELETE /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 13:45:49.401972 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-57714e17-e9e5-4cb5-b579-cfc6ba9445a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:49.402583 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-57714e17-e9e5-4cb5-b579-cfc6ba9445a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:49.408750 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-57714e17-e9e5-4cb5-b579-cfc6ba9445a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:49.409248 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-57714e17-e9e5-4cb5-b579-cfc6ba9445a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:49.409685 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-57714e17-e9e5-4cb5-b579-cfc6ba9445a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:49.411044 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-57714e17-e9e5-4cb5-b579-cfc6ba9445a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:49.411648 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-57714e17-e9e5-4cb5-b579-cfc6ba9445a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:49.412135 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-57714e17-e9e5-4cb5-b579-cfc6ba9445a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:49.557920 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-57714e17-e9e5-4cb5-b579-cfc6ba9445a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:49.566660 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-57714e17-e9e5-4cb5-b579-cfc6ba9445a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:49.568149 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-57714e17-e9e5-4cb5-b579-cfc6ba9445a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:49.569324 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-57714e17-e9e5-4cb5-b579-cfc6ba9445a9 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1724 microversion: 2.20 time: 0.171406 Aug 24 13:45:49.569867 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 448/880] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:45:49 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:45:50.209694 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-410c56bf-0205-4a4c-94e4-58447a4b4f6d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:50.210409 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-410c56bf-0205-4a4c-94e4-58447a4b4f6d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:50.217146 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-410c56bf-0205-4a4c-94e4-58447a4b4f6d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:50.217645 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-410c56bf-0205-4a4c-94e4-58447a4b4f6d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:50.218676 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-410c56bf-0205-4a4c-94e4-58447a4b4f6d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:50.218799 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-410c56bf-0205-4a4c-94e4-58447a4b4f6d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:50.219238 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-410c56bf-0205-4a4c-94e4-58447a4b4f6d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:50.220033 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-410c56bf-0205-4a4c-94e4-58447a4b4f6d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:50.382065 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-410c56bf-0205-4a4c-94e4-58447a4b4f6d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:50.390963 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-410c56bf-0205-4a4c-94e4-58447a4b4f6d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6" status: 200 len: 1264 microversion: 2.1 time: 0.187043 Aug 24 13:45:50.391783 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 433/881] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:50 2022] GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:50.593095 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-45e175d0-dc2a-4856-b558-56788e8ed7af tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:50.593775 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-45e175d0-dc2a-4856-b558-56788e8ed7af tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:50.595611 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=2 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:45:50.596308 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=6 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:45:50.602165 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-45e175d0-dc2a-4856-b558-56788e8ed7af tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:50.602652 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-45e175d0-dc2a-4856-b558-56788e8ed7af tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:50.603098 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-45e175d0-dc2a-4856-b558-56788e8ed7af tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:50.603951 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-45e175d0-dc2a-4856-b558-56788e8ed7af tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:50.604449 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-45e175d0-dc2a-4856-b558-56788e8ed7af tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:50.604874 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-45e175d0-dc2a-4856-b558-56788e8ed7af tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:50.756607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-45e175d0-dc2a-4856-b558-56788e8ed7af tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:50.770415 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-45e175d0-dc2a-4856-b558-56788e8ed7af tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:50.770415 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-45e175d0-dc2a-4856-b558-56788e8ed7af tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:50.771344 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-45e175d0-dc2a-4856-b558-56788e8ed7af tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1724 microversion: 2.20 time: 0.182544 Aug 24 13:45:50.771931 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 449/882] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:45:50 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:45:51.413364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-dddbcb34-f2d8-4e50-9a59-5e28e2ac5589 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:51.413999 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-dddbcb34-f2d8-4e50-9a59-5e28e2ac5589 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:51.416168 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=2 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:45:51.422032 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dddbcb34-f2d8-4e50-9a59-5e28e2ac5589 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:51.422540 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dddbcb34-f2d8-4e50-9a59-5e28e2ac5589 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:51.422984 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dddbcb34-f2d8-4e50-9a59-5e28e2ac5589 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:51.423710 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dddbcb34-f2d8-4e50-9a59-5e28e2ac5589 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:51.424206 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dddbcb34-f2d8-4e50-9a59-5e28e2ac5589 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:51.424641 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dddbcb34-f2d8-4e50-9a59-5e28e2ac5589 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:51.589259 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-dddbcb34-f2d8-4e50-9a59-5e28e2ac5589 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:51.597286 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-dddbcb34-f2d8-4e50-9a59-5e28e2ac5589 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6" status: 200 len: 1264 microversion: 2.1 time: 0.188961 Aug 24 13:45:51.598901 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 434/883] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:51 2022] GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:51.795886 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-3ad7e967-50a8-41f8-93db-498a00feb562 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:51.796520 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-3ad7e967-50a8-41f8-93db-498a00feb562 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:51.803277 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3ad7e967-50a8-41f8-93db-498a00feb562 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:51.803873 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3ad7e967-50a8-41f8-93db-498a00feb562 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:51.804340 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3ad7e967-50a8-41f8-93db-498a00feb562 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:51.805090 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3ad7e967-50a8-41f8-93db-498a00feb562 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:51.805545 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3ad7e967-50a8-41f8-93db-498a00feb562 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:51.805966 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3ad7e967-50a8-41f8-93db-498a00feb562 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:51.953741 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-3ad7e967-50a8-41f8-93db-498a00feb562 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:51.964112 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-3ad7e967-50a8-41f8-93db-498a00feb562 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:51.965711 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-3ad7e967-50a8-41f8-93db-498a00feb562 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:51.966870 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-3ad7e967-50a8-41f8-93db-498a00feb562 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1724 microversion: 2.20 time: 0.175311 Aug 24 13:45:51.967453 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 450/884] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:45:51 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:45:52.201607 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-98aa830a-e106-46bd-b544-557cd69a2e23 req-ba6a35ca-9e5c-44b7-a6d3-c93b51dba69d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac19de18-372a-4cb9-bb59-0cb4b15e80b4", "name": "network-vif-deleted", "tag": "a11fdd6d-daa9-44f9-b1cc-eeb70dbbd497"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:45:52.214060 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-98aa830a-e106-46bd-b544-557cd69a2e23 req-ba6a35ca-9e5c-44b7-a6d3-c93b51dba69d service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:52.214618 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-98aa830a-e106-46bd-b544-557cd69a2e23 req-ba6a35ca-9e5c-44b7-a6d3-c93b51dba69d service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:52.215151 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-98aa830a-e106-46bd-b544-557cd69a2e23 req-ba6a35ca-9e5c-44b7-a6d3-c93b51dba69d service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:52.226985 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-98aa830a-e106-46bd-b544-557cd69a2e23 req-ba6a35ca-9e5c-44b7-a6d3-c93b51dba69d service nova] Creating event network-vif-deleted:a11fdd6d-daa9-44f9-b1cc-eeb70dbbd497 for instance ac19de18-372a-4cb9-bb59-0cb4b15e80b4 on hv-cinder-77957 Aug 24 13:45:52.232199 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-98aa830a-e106-46bd-b544-557cd69a2e23 req-ba6a35ca-9e5c-44b7-a6d3-c93b51dba69d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034699 Aug 24 13:45:52.232961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 435/885] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:45:52.621364 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-fba7345b-3d74-4157-8f3a-3e9ad3b5db2e tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:52.622128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-fba7345b-3d74-4157-8f3a-3e9ad3b5db2e tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:52.629871 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fba7345b-3d74-4157-8f3a-3e9ad3b5db2e tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:52.630672 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fba7345b-3d74-4157-8f3a-3e9ad3b5db2e tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:52.631358 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fba7345b-3d74-4157-8f3a-3e9ad3b5db2e tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:52.632683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fba7345b-3d74-4157-8f3a-3e9ad3b5db2e tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:52.633231 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fba7345b-3d74-4157-8f3a-3e9ad3b5db2e tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:52.633890 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-fba7345b-3d74-4157-8f3a-3e9ad3b5db2e tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:52.779201 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-fba7345b-3d74-4157-8f3a-3e9ad3b5db2e tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:52.788274 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-fba7345b-3d74-4157-8f3a-3e9ad3b5db2e tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6" status: 200 len: 1264 microversion: 2.1 time: 0.172292 Aug 24 13:45:52.788846 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 451/886] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:52 2022] GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:52.993296 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-1f3c7ab8-c324-42a7-915f-7a80397ccc56 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:52.994150 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-1f3c7ab8-c324-42a7-915f-7a80397ccc56 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:53.000486 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1f3c7ab8-c324-42a7-915f-7a80397ccc56 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:53.001123 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1f3c7ab8-c324-42a7-915f-7a80397ccc56 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:53.001563 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1f3c7ab8-c324-42a7-915f-7a80397ccc56 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:53.002269 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1f3c7ab8-c324-42a7-915f-7a80397ccc56 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:53.003800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1f3c7ab8-c324-42a7-915f-7a80397ccc56 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:53.004413 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1f3c7ab8-c324-42a7-915f-7a80397ccc56 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:53.040859 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1f3c7ab8-c324-42a7-915f-7a80397ccc56 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:53.041287 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1f3c7ab8-c324-42a7-915f-7a80397ccc56 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:53.041728 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1f3c7ab8-c324-42a7-915f-7a80397ccc56 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:53.042253 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.objects.instance [None req-1f3c7ab8-c324-42a7-915f-7a80397ccc56 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lazy-loading 'fault' on Instance uuid ac19de18-372a-4cb9-bb59-0cb4b15e80b4 {{(pid=133014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:45:53.086300 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-1f3c7ab8-c324-42a7-915f-7a80397ccc56 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:53.094861 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-1f3c7ab8-c324-42a7-915f-7a80397ccc56 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:53.096467 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-1f3c7ab8-c324-42a7-915f-7a80397ccc56 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '773dc87736034257b3d1ae2e8f02bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3794670e8d4c9985547d557d6969e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:53.098201 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-1f3c7ab8-c324-42a7-915f-7a80397ccc56 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 200 len: 1371 microversion: 2.20 time: 0.110278 Aug 24 13:45:53.098829 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 436/887] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:45:52 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 1371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 13:45:53.809488 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-c8873398-f370-413f-8b4e-d7f790d051d7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:53.810119 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-c8873398-f370-413f-8b4e-d7f790d051d7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:53.816943 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c8873398-f370-413f-8b4e-d7f790d051d7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:53.817421 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c8873398-f370-413f-8b4e-d7f790d051d7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:53.818214 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c8873398-f370-413f-8b4e-d7f790d051d7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:53.818899 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c8873398-f370-413f-8b4e-d7f790d051d7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:53.819348 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c8873398-f370-413f-8b4e-d7f790d051d7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:53.819770 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c8873398-f370-413f-8b4e-d7f790d051d7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:53.958021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c8873398-f370-413f-8b4e-d7f790d051d7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:53.966448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-c8873398-f370-413f-8b4e-d7f790d051d7 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6" status: 200 len: 1264 microversion: 2.1 time: 0.160885 Aug 24 13:45:53.967083 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 452/888] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:53 2022] GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:45:54.125570 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a93f4a2d-3016-4aa1-84e3-904334d5d788 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:54.126096 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a93f4a2d-3016-4aa1-84e3-904334d5d788 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:54.133386 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a93f4a2d-3016-4aa1-84e3-904334d5d788 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:54.133877 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a93f4a2d-3016-4aa1-84e3-904334d5d788 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:54.134323 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a93f4a2d-3016-4aa1-84e3-904334d5d788 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:54.135010 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a93f4a2d-3016-4aa1-84e3-904334d5d788 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:54.135468 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a93f4a2d-3016-4aa1-84e3-904334d5d788 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:54.135893 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a93f4a2d-3016-4aa1-84e3-904334d5d788 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:54.150861 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-a93f4a2d-3016-4aa1-84e3-904334d5d788 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] HTTP exception thrown: Instance ac19de18-372a-4cb9-bb59-0cb4b15e80b4 could not be found. Aug 24 13:45:54.152579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a93f4a2d-3016-4aa1-84e3-904334d5d788 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Request method failure captured: Aug 24 13:45:54.152579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 HTTP/1.1 Aug 24 13:45:54.152579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:45:54.152579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:45:54.152579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:45:54.152579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:45:54.152579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:45:54.152579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:45:54.152579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:45:54.152579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:45:54.152579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBinWpOk7vD7uAwOZuIB6_DAzYh_0hcgP0zPNptvzinwWHzkIeNkrRr4Zoy0a3D10KctxnVwVtCdpCsH-hkQHSYN5wyp9fGVh-j6-Ts_oux84dFh7xqQCAh8qjlIeC4ED_c9aHc_CIi9Wdacj1ETZHFHn6xsJWdObx9IaiVl-5EE7L64 Aug 24 13:45:54.152579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:45:54.152579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:45:54.152579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:45:54.152579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:45:54.152579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 13:45:54.152579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:45:54.152579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:45:54.152579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 4a3794670e8d4c9985547d557d6969e0 Aug 24 13:45:54.152579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1315367245 Aug 24 13:45:54.152579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:45:54.152579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:45:54.158259 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4a3794670e8d4c9985547d557d6969e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4a3794670e8d4c9985547d557d6969e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4a3794670e8d4c9985547d557d6969e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4a3794670e8d4c9985547d557d6969e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:45:54.158259 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1315367245 Aug 24 13:45:54.158259 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 4a3794670e8d4c9985547d557d6969e0 Aug 24 13:45:54.158259 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1315367245 Aug 24 13:45:54.158259 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-AttachVolumeShelveTestJSON-1315367245-project Aug 24 13:45:54.158259 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:45:54.158259 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:45:54.158259 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: 773dc87736034257b3d1ae2e8f02bf23 Aug 24 13:45:54.158259 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1315367245-project Aug 24 13:45:54.158259 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:45:54.158259 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Instance ac19de18-372a-4cb9-bb59-0cb4b15e80b4 could not be found. Aug 24 13:45:54.158259 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': 'ac19de18-372a-4cb9-bb59-0cb4b15e80b4'} Aug 24 13:45:54.159208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:45:54.159208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:54.159208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:45:54.159208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:45:54.159208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:45:54.159208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:45:54.159208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:45:54.159208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:45:54.159208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:45:54.159208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:45:54.159208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac19de18-372a-4cb9-bb59-0cb4b15e80b4 could not be found. Aug 24 13:45:54.159208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:54.159208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:54.159208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:54.159208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:54.159208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:54.159208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:54.159208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:45:54.159208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:45:54.159208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:45:54.161130 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:45:54.161130 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:45:54.161130 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:45:54.161130 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:45:54.161130 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:45:54.161130 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:45:54.161130 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:45:54.161130 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac19de18-372a-4cb9-bb59-0cb4b15e80b4 could not be found. Aug 24 13:45:54.161130 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:54.161130 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:54.161130 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:54.161130 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:54.161130 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:54.161130 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:54.161130 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:45:54.161130 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:45:54.161130 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac19de18-372a-4cb9-bb59-0cb4b15e80b4 could not be found. Aug 24 13:45:54.161130 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:54.163359 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a93f4a2d-3016-4aa1-84e3-904334d5d788 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Returning 404 to user: Instance ac19de18-372a-4cb9-bb59-0cb4b15e80b4 could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:45:54.163359 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a93f4a2d-3016-4aa1-84e3-904334d5d788 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 404 len: 111 microversion: 2.20 time: 0.032581 Aug 24 13:45:54.163359 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 437/889] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:45:54 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 13:45:54.164866 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a79eee15-7486-477e-824d-19e392af4554 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '.version_select at 0x7f96c209eb80>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:54.264324 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a79eee15-7486-477e-824d-19e392af4554 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-480623443" status: 204 len: 0 microversion: 2.20 time: 0.104175 Aug 24 13:45:54.264892 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 453/890] 10.222.0.73 () {60 vars in 1259 bytes} [Wed Aug 24 13:45:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-480623443 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 13:45:54.987127 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-31b613b0-c9d5-4a32-acc3-9c95db29d5d5 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:54.987753 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-31b613b0-c9d5-4a32-acc3-9c95db29d5d5 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:54.996155 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-31b613b0-c9d5-4a32-acc3-9c95db29d5d5 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:54.996961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-31b613b0-c9d5-4a32-acc3-9c95db29d5d5 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:54.997525 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-31b613b0-c9d5-4a32-acc3-9c95db29d5d5 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:54.998639 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-31b613b0-c9d5-4a32-acc3-9c95db29d5d5 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:54.999340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-31b613b0-c9d5-4a32-acc3-9c95db29d5d5 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:55.000135 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-31b613b0-c9d5-4a32-acc3-9c95db29d5d5 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:55.231863 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-31b613b0-c9d5-4a32-acc3-9c95db29d5d5 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:55.241455 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-31b613b0-c9d5-4a32-acc3-9c95db29d5d5 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6" status: 200 len: 1264 microversion: 2.1 time: 0.258106 Aug 24 13:45:55.242024 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 438/891] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:54 2022] GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 => generated 1264 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:56.279439 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-f82a1eba-9025-478a-9a7e-8d686af034ce tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:56.280047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-f82a1eba-9025-478a-9a7e-8d686af034ce tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:56.286255 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f82a1eba-9025-478a-9a7e-8d686af034ce tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:56.286741 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f82a1eba-9025-478a-9a7e-8d686af034ce tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:56.287181 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f82a1eba-9025-478a-9a7e-8d686af034ce tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:56.288792 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f82a1eba-9025-478a-9a7e-8d686af034ce tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:56.289398 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f82a1eba-9025-478a-9a7e-8d686af034ce tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:56.289833 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f82a1eba-9025-478a-9a7e-8d686af034ce tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:56.427814 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f82a1eba-9025-478a-9a7e-8d686af034ce tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:56.435755 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-f82a1eba-9025-478a-9a7e-8d686af034ce tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6" status: 200 len: 1264 microversion: 2.1 time: 0.160766 Aug 24 13:45:56.436340 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 454/892] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:56 2022] GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:57.456359 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-91ebca24-b7b4-46a5-929c-ec72da55d0cb tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:57.456964 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-91ebca24-b7b4-46a5-929c-ec72da55d0cb tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:57.464211 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-91ebca24-b7b4-46a5-929c-ec72da55d0cb tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:57.464688 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-91ebca24-b7b4-46a5-929c-ec72da55d0cb tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:57.465117 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-91ebca24-b7b4-46a5-929c-ec72da55d0cb tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:57.465797 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-91ebca24-b7b4-46a5-929c-ec72da55d0cb tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:57.466252 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-91ebca24-b7b4-46a5-929c-ec72da55d0cb tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:57.466669 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-91ebca24-b7b4-46a5-929c-ec72da55d0cb tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:57.600902 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-91ebca24-b7b4-46a5-929c-ec72da55d0cb tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:57.610800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-91ebca24-b7b4-46a5-929c-ec72da55d0cb tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6" status: 200 len: 1264 microversion: 2.1 time: 0.157244 Aug 24 13:45:57.610800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 439/893] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:57 2022] GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:58.633168 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-23084d6a-3a2c-40e9-b685-46987d8628d9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:58.633788 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-23084d6a-3a2c-40e9-b685-46987d8628d9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:58.640160 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-23084d6a-3a2c-40e9-b685-46987d8628d9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:58.640671 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-23084d6a-3a2c-40e9-b685-46987d8628d9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:58.641108 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-23084d6a-3a2c-40e9-b685-46987d8628d9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:58.641800 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-23084d6a-3a2c-40e9-b685-46987d8628d9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:58.642254 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-23084d6a-3a2c-40e9-b685-46987d8628d9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:58.642672 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-23084d6a-3a2c-40e9-b685-46987d8628d9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:58.671443 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-7807fd99-1652-46b2-97d7-c9171b529845 req-056cb78b-c615-409a-81dc-dd307880875d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dba10a5-24cb-4641-914e-7558614f82a6", "name": "network-vif-plugged", "status": "completed", "tag": "ec946f8f-f434-42c3-90a3-60ce66ddf0c3"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:45:58.682314 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-7807fd99-1652-46b2-97d7-c9171b529845 req-056cb78b-c615-409a-81dc-dd307880875d service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:58.682736 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-7807fd99-1652-46b2-97d7-c9171b529845 req-056cb78b-c615-409a-81dc-dd307880875d service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:58.683256 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-7807fd99-1652-46b2-97d7-c9171b529845 req-056cb78b-c615-409a-81dc-dd307880875d service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:58.695708 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-7807fd99-1652-46b2-97d7-c9171b529845 req-056cb78b-c615-409a-81dc-dd307880875d service nova] Creating event network-vif-plugged:ec946f8f-f434-42c3-90a3-60ce66ddf0c3 for instance 1dba10a5-24cb-4641-914e-7558614f82a6 on hv-cinder-77957 Aug 24 13:45:58.700922 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-7807fd99-1652-46b2-97d7-c9171b529845 req-056cb78b-c615-409a-81dc-dd307880875d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033635 Aug 24 13:45:58.701643 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 440/894] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:45:58.805578 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-23084d6a-3a2c-40e9-b685-46987d8628d9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:45:58.809099 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=100 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:45:58.814100 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-23084d6a-3a2c-40e9-b685-46987d8628d9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6" status: 200 len: 1264 microversion: 2.1 time: 0.184857 Aug 24 13:45:58.814975 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 455/895] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:58 2022] GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:45:59.802047 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-c7647543-c6c3-4117-aa7d-d4bb14dcd0de tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:59.802719 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-c7647543-c6c3-4117-aa7d-d4bb14dcd0de tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:59.809095 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c7647543-c6c3-4117-aa7d-d4bb14dcd0de tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:59.809584 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c7647543-c6c3-4117-aa7d-d4bb14dcd0de tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:59.810137 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c7647543-c6c3-4117-aa7d-d4bb14dcd0de tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:59.810794 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c7647543-c6c3-4117-aa7d-d4bb14dcd0de tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:59.811269 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c7647543-c6c3-4117-aa7d-d4bb14dcd0de tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:59.811689 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c7647543-c6c3-4117-aa7d-d4bb14dcd0de tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:59.826331 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-c7647543-c6c3-4117-aa7d-d4bb14dcd0de tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] HTTP exception thrown: Instance ac19de18-372a-4cb9-bb59-0cb4b15e80b4 could not be found. Aug 24 13:45:59.828011 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-c7647543-c6c3-4117-aa7d-d4bb14dcd0de tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Request method failure captured: Aug 24 13:45:59.828011 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: DELETE /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 HTTP/1.1 Aug 24 13:45:59.828011 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:45:59.828011 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:45:59.828011 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:45:59.828011 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:45:59.828011 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:45:59.828011 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:45:59.828011 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:45:59.828011 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:45:59.828011 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBinWpOk7vD7uAwOZuIB6_DAzYh_0hcgP0zPNptvzinwWHzkIeNkrRr4Zoy0a3D10KctxnVwVtCdpCsH-hkQHSYN5wyp9fGVh-j6-Ts_oux84dFh7xqQCAh8qjlIeC4ED_c9aHc_CIi9Wdacj1ETZHFHn6xsJWdObx9IaiVl-5EE7L64 Aug 24 13:45:59.828011 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:45:59.828011 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:45:59.828011 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:45:59.828011 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:45:59.828011 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 13:45:59.828011 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:45:59.828011 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:45:59.828011 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 4a3794670e8d4c9985547d557d6969e0 Aug 24 13:45:59.828011 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1315367245 Aug 24 13:45:59.828011 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:45:59.828011 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:45:59.829690 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4a3794670e8d4c9985547d557d6969e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4a3794670e8d4c9985547d557d6969e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4a3794670e8d4c9985547d557d6969e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4a3794670e8d4c9985547d557d6969e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:45:59.829690 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1315367245 Aug 24 13:45:59.829690 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 4a3794670e8d4c9985547d557d6969e0 Aug 24 13:45:59.829690 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1315367245 Aug 24 13:45:59.829690 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-AttachVolumeShelveTestJSON-1315367245-project Aug 24 13:45:59.829690 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:45:59.829690 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:45:59.829690 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: 773dc87736034257b3d1ae2e8f02bf23 Aug 24 13:45:59.829690 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1315367245-project Aug 24 13:45:59.829690 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:45:59.829690 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Instance ac19de18-372a-4cb9-bb59-0cb4b15e80b4 could not be found. Aug 24 13:45:59.829690 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': 'ac19de18-372a-4cb9-bb59-0cb4b15e80b4'} Aug 24 13:45:59.832036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:45:59.832036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:59.832036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:45:59.832036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:45:59.832036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:45:59.832036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:45:59.832036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:45:59.832036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:45:59.832036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:45:59.832036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:45:59.832036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac19de18-372a-4cb9-bb59-0cb4b15e80b4 could not be found. Aug 24 13:45:59.832036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:59.832036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:59.832036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:59.832036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:59.832036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:59.832036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:59.832036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:45:59.832036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:45:59.832036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:45:59.833667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:45:59.833667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 13:45:59.833667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 13:45:59.833667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 13:45:59.833667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 13:45:59.833667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:45:59.833667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:45:59.833667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:45:59.833667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:45:59.833667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac19de18-372a-4cb9-bb59-0cb4b15e80b4 could not be found. Aug 24 13:45:59.833667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:59.833667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:59.833667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:59.833667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:59.833667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:59.833667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:59.833667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:45:59.833667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:45:59.833667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac19de18-372a-4cb9-bb59-0cb4b15e80b4 could not be found. Aug 24 13:45:59.833667 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:59.836465 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-c7647543-c6c3-4117-aa7d-d4bb14dcd0de tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Returning 404 to user: Instance ac19de18-372a-4cb9-bb59-0cb4b15e80b4 could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:45:59.836465 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-c7647543-c6c3-4117-aa7d-d4bb14dcd0de tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 404 len: 111 microversion: 2.20 time: 0.032199 Aug 24 13:45:59.836465 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 441/896] 10.222.0.73 () {60 vars in 1280 bytes} [Wed Aug 24 13:45:59 2022] DELETE /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 13:45:59.839230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-5d6a4d3d-2e4b-4940-932f-b471715668df tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:59.840397 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-5d6a4d3d-2e4b-4940-932f-b471715668df tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:59.841601 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-386bd735-63da-45b3-8ce0-073c504d5180 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:45:59.842216 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-386bd735-63da-45b3-8ce0-073c504d5180 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: ac19de18-372a-4cb9-bb59-0cb4b15e80b4] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:45:59.847308 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5d6a4d3d-2e4b-4940-932f-b471715668df tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:59.847799 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5d6a4d3d-2e4b-4940-932f-b471715668df tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:59.848261 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5d6a4d3d-2e4b-4940-932f-b471715668df tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:59.848403 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-386bd735-63da-45b3-8ce0-073c504d5180 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:59.848752 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-386bd735-63da-45b3-8ce0-073c504d5180 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:59.848959 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5d6a4d3d-2e4b-4940-932f-b471715668df tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:59.849180 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-386bd735-63da-45b3-8ce0-073c504d5180 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:59.849414 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5d6a4d3d-2e4b-4940-932f-b471715668df tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:59.849838 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5d6a4d3d-2e4b-4940-932f-b471715668df tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:59.849940 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-386bd735-63da-45b3-8ce0-073c504d5180 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:45:59.850391 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-386bd735-63da-45b3-8ce0-073c504d5180 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:45:59.850769 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-386bd735-63da-45b3-8ce0-073c504d5180 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:45:59.864292 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-386bd735-63da-45b3-8ce0-073c504d5180 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] HTTP exception thrown: Instance ac19de18-372a-4cb9-bb59-0cb4b15e80b4 could not be found. Aug 24 13:45:59.866487 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-386bd735-63da-45b3-8ce0-073c504d5180 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Request method failure captured: Aug 24 13:45:59.866487 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 HTTP/1.1 Aug 24 13:45:59.866487 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:45:59.866487 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:45:59.866487 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:45:59.866487 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:45:59.866487 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:45:59.866487 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:45:59.866487 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:45:59.866487 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:45:59.866487 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBinWpOk7vD7uAwOZuIB6_DAzYh_0hcgP0zPNptvzinwWHzkIeNkrRr4Zoy0a3D10KctxnVwVtCdpCsH-hkQHSYN5wyp9fGVh-j6-Ts_oux84dFh7xqQCAh8qjlIeC4ED_c9aHc_CIi9Wdacj1ETZHFHn6xsJWdObx9IaiVl-5EE7L64 Aug 24 13:45:59.866487 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:45:59.866487 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:45:59.866487 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:45:59.866487 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:45:59.866487 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 13:45:59.866487 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:45:59.866487 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:45:59.866487 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 4a3794670e8d4c9985547d557d6969e0 Aug 24 13:45:59.866487 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1315367245 Aug 24 13:45:59.866487 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:45:59.866487 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:45:59.868372 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4a3794670e8d4c9985547d557d6969e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4a3794670e8d4c9985547d557d6969e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4a3794670e8d4c9985547d557d6969e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4a3794670e8d4c9985547d557d6969e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:45:59.868372 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1315367245 Aug 24 13:45:59.868372 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 4a3794670e8d4c9985547d557d6969e0 Aug 24 13:45:59.868372 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1315367245 Aug 24 13:45:59.868372 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-AttachVolumeShelveTestJSON-1315367245-project Aug 24 13:45:59.868372 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:45:59.868372 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:45:59.868372 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: 773dc87736034257b3d1ae2e8f02bf23 Aug 24 13:45:59.868372 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1315367245-project Aug 24 13:45:59.868372 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:45:59.868372 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Instance ac19de18-372a-4cb9-bb59-0cb4b15e80b4 could not be found. Aug 24 13:45:59.868372 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': 'ac19de18-372a-4cb9-bb59-0cb4b15e80b4'} Aug 24 13:45:59.869128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:45:59.869128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:59.869128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:45:59.869128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:45:59.869128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:45:59.869128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:45:59.869128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:45:59.869128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:45:59.869128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:45:59.869128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:45:59.869128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac19de18-372a-4cb9-bb59-0cb4b15e80b4 could not be found. Aug 24 13:45:59.869128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:59.869128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:59.869128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:59.869128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:59.869128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:59.869128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:59.869128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:45:59.869128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:45:59.869128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:45:59.870705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:45:59.870705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:45:59.870705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:45:59.870705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:45:59.870705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:45:59.870705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:45:59.870705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:45:59.870705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac19de18-372a-4cb9-bb59-0cb4b15e80b4 could not be found. Aug 24 13:45:59.870705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:59.870705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:45:59.870705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:59.870705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:45:59.870705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:45:59.870705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:45:59.870705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:45:59.870705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:45:59.870705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac19de18-372a-4cb9-bb59-0cb4b15e80b4 could not be found. Aug 24 13:45:59.870705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:45:59.872226 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-386bd735-63da-45b3-8ce0-073c504d5180 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Returning 404 to user: Instance ac19de18-372a-4cb9-bb59-0cb4b15e80b4 could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:45:59.872226 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-386bd735-63da-45b3-8ce0-073c504d5180 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4" status: 404 len: 111 microversion: 2.20 time: 0.030128 Aug 24 13:45:59.872226 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 442/897] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:45:59 2022] GET /compute/v2.1/servers/ac19de18-372a-4cb9-bb59-0cb4b15e80b4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 13:46:00.002887 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-5d6a4d3d-2e4b-4940-932f-b471715668df tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:46:00.014075 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-5d6a4d3d-2e4b-4940-932f-b471715668df tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6" status: 200 len: 1264 microversion: 2.1 time: 0.179487 Aug 24 13:46:00.015416 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 456/898] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:45:59 2022] GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:46:01.044643 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-273be104-85a4-45cb-9c65-2c533970513f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:01.044643 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-273be104-85a4-45cb-9c65-2c533970513f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:01.049932 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-273be104-85a4-45cb-9c65-2c533970513f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:01.050437 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-273be104-85a4-45cb-9c65-2c533970513f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:01.050881 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-273be104-85a4-45cb-9c65-2c533970513f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:01.051594 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-273be104-85a4-45cb-9c65-2c533970513f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:01.052124 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-273be104-85a4-45cb-9c65-2c533970513f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:01.052496 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-273be104-85a4-45cb-9c65-2c533970513f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:01.210095 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-273be104-85a4-45cb-9c65-2c533970513f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:46:01.218350 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-273be104-85a4-45cb-9c65-2c533970513f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6" status: 200 len: 1450 microversion: 2.1 time: 0.183148 Aug 24 13:46:01.218993 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 443/899] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:46:01 2022] GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 => generated 1450 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:46:01.232390 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-50368bd8-60c9-42bf-8421-14d848106b8f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:01.232908 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-50368bd8-60c9-42bf-8421-14d848106b8f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:01.239435 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-50368bd8-60c9-42bf-8421-14d848106b8f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:01.249489 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-50368bd8-60c9-42bf-8421-14d848106b8f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:01.249657 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-26d981c0-d38d-4003-9d97-9f9f50a53520 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:01.249787 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-50368bd8-60c9-42bf-8421-14d848106b8f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:01.249870 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-26d981c0-d38d-4003-9d97-9f9f50a53520 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:01.249973 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-50368bd8-60c9-42bf-8421-14d848106b8f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:01.249973 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-50368bd8-60c9-42bf-8421-14d848106b8f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:01.249973 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-50368bd8-60c9-42bf-8421-14d848106b8f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:01.250177 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-26d981c0-d38d-4003-9d97-9f9f50a53520 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:01.250177 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-26d981c0-d38d-4003-9d97-9f9f50a53520 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:01.250177 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-26d981c0-d38d-4003-9d97-9f9f50a53520 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:01.250177 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-26d981c0-d38d-4003-9d97-9f9f50a53520 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:01.250460 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-26d981c0-d38d-4003-9d97-9f9f50a53520 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:01.250460 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-26d981c0-d38d-4003-9d97-9f9f50a53520 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:01.255531 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.wsgi [None req-50368bd8-60c9-42bf-8421-14d848106b8f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] HTTP exception thrown: Instance 53bade32-e7bf-4ace-9b68-0458f257feff could not be found. Aug 24 13:46:01.257843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-50368bd8-60c9-42bf-8421-14d848106b8f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Request method failure captured: Aug 24 13:46:01.257843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: DELETE /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff HTTP/1.1 Aug 24 13:46:01.257843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:46:01.257843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:46:01.257843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:46:01.257843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 0 Aug 24 13:46:01.257843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:46:01.257843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:46:01.257843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:46:01.257843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:46:01.257843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBinWpOk7vD7uAwOZuIB6_DAzYh_0hcgP0zPNptvzinwWHzkIeNkrRr4Zoy0a3D10KctxnVwVtCdpCsH-hkQHSYN5wyp9fGVh-j6-Ts_oux84dFh7xqQCAh8qjlIeC4ED_c9aHc_CIi9Wdacj1ETZHFHn6xsJWdObx9IaiVl-5EE7L64 Aug 24 13:46:01.257843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:46:01.257843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:46:01.257843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:46:01.257843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:46:01.257843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 13:46:01.257843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:46:01.257843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:46:01.257843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: 4a3794670e8d4c9985547d557d6969e0 Aug 24 13:46:01.257843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1315367245 Aug 24 13:46:01.257843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:46:01.257843 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:46:01.259548 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4a3794670e8d4c9985547d557d6969e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4a3794670e8d4c9985547d557d6969e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4a3794670e8d4c9985547d557d6969e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4a3794670e8d4c9985547d557d6969e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:46:01.259548 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1315367245 Aug 24 13:46:01.259548 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: 4a3794670e8d4c9985547d557d6969e0 Aug 24 13:46:01.259548 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1315367245 Aug 24 13:46:01.259548 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-AttachVolumeShelveTestJSON-1315367245-project Aug 24 13:46:01.259548 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:46:01.259548 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:46:01.259548 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: 773dc87736034257b3d1ae2e8f02bf23 Aug 24 13:46:01.259548 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1315367245-project Aug 24 13:46:01.259548 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: > Aug 24 13:46:01.259548 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Instance 53bade32-e7bf-4ace-9b68-0458f257feff could not be found. Aug 24 13:46:01.259548 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'id': '53bade32-e7bf-4ace-9b68-0458f257feff'} Aug 24 13:46:01.260423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:46:01.260423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:46:01.260423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:46:01.260423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:46:01.260423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:46:01.260423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:46:01.260423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:46:01.260423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:46:01.260423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:46:01.260423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:46:01.260423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53bade32-e7bf-4ace-9b68-0458f257feff could not be found. Aug 24 13:46:01.260423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:46:01.260423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:46:01.260423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:46:01.260423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:46:01.260423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:46:01.260423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:46:01.260423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:46:01.260423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:46:01.260423 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:46:01.261877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:46:01.261877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 13:46:01.261877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 13:46:01.261877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 13:46:01.261877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 13:46:01.261877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:46:01.261877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:46:01.261877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:46:01.261877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:46:01.261877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53bade32-e7bf-4ace-9b68-0458f257feff could not be found. Aug 24 13:46:01.261877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:46:01.261877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:46:01.261877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:46:01.261877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:46:01.261877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:46:01.261877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:46:01.261877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:46:01.261877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:46:01.261877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53bade32-e7bf-4ace-9b68-0458f257feff could not be found. Aug 24 13:46:01.261877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:46:01.263584 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-50368bd8-60c9-42bf-8421-14d848106b8f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Returning 404 to user: Instance 53bade32-e7bf-4ace-9b68-0458f257feff could not be found. {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:46:01.263584 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-50368bd8-60c9-42bf-8421-14d848106b8f tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "DELETE /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 404 len: 111 microversion: 2.20 time: 0.030917 Aug 24 13:46:01.263584 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 457/900] 10.222.0.73 () {60 vars in 1280 bytes} [Wed Aug 24 13:46:01 2022] DELETE /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 13:46:01.268408 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-7a8cf07e-b078-47a2-8524-608c80e22763 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:01.269037 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-7a8cf07e-b078-47a2-8524-608c80e22763 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] [instance: 53bade32-e7bf-4ace-9b68-0458f257feff] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:01.276049 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7a8cf07e-b078-47a2-8524-608c80e22763 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:01.276591 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7a8cf07e-b078-47a2-8524-608c80e22763 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:01.277033 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7a8cf07e-b078-47a2-8524-608c80e22763 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:01.277740 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7a8cf07e-b078-47a2-8524-608c80e22763 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:01.278198 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7a8cf07e-b078-47a2-8524-608c80e22763 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:01.278639 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7a8cf07e-b078-47a2-8524-608c80e22763 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:01.293105 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.wsgi [None req-7a8cf07e-b078-47a2-8524-608c80e22763 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] HTTP exception thrown: Instance 53bade32-e7bf-4ace-9b68-0458f257feff could not be found. Aug 24 13:46:01.294728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-7a8cf07e-b078-47a2-8524-608c80e22763 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Request method failure captured: Aug 24 13:46:01.294728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff HTTP/1.1 Aug 24 13:46:01.294728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:46:01.294728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:46:01.294728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:46:01.294728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 0 Aug 24 13:46:01.294728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:46:01.294728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:46:01.294728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:46:01.294728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:46:01.294728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBinWpOk7vD7uAwOZuIB6_DAzYh_0hcgP0zPNptvzinwWHzkIeNkrRr4Zoy0a3D10KctxnVwVtCdpCsH-hkQHSYN5wyp9fGVh-j6-Ts_oux84dFh7xqQCAh8qjlIeC4ED_c9aHc_CIi9Wdacj1ETZHFHn6xsJWdObx9IaiVl-5EE7L64 Aug 24 13:46:01.294728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:46:01.294728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:46:01.294728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:46:01.294728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:46:01.294728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 13:46:01.294728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:46:01.294728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:46:01.294728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: 4a3794670e8d4c9985547d557d6969e0 Aug 24 13:46:01.294728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1315367245 Aug 24 13:46:01.294728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:46:01.294728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:46:01.296052 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4a3794670e8d4c9985547d557d6969e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4a3794670e8d4c9985547d557d6969e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4a3794670e8d4c9985547d557d6969e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4a3794670e8d4c9985547d557d6969e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:46:01.296052 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1315367245 Aug 24 13:46:01.296052 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: 4a3794670e8d4c9985547d557d6969e0 Aug 24 13:46:01.296052 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1315367245 Aug 24 13:46:01.296052 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-AttachVolumeShelveTestJSON-1315367245-project Aug 24 13:46:01.296052 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:46:01.296052 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:46:01.296052 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: 773dc87736034257b3d1ae2e8f02bf23 Aug 24 13:46:01.296052 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1315367245-project Aug 24 13:46:01.296052 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: > Aug 24 13:46:01.296052 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Instance 53bade32-e7bf-4ace-9b68-0458f257feff could not be found. Aug 24 13:46:01.296052 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'id': '53bade32-e7bf-4ace-9b68-0458f257feff'} Aug 24 13:46:01.297258 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:46:01.297258 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:46:01.297258 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:46:01.297258 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:46:01.297258 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:46:01.297258 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:46:01.297258 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:46:01.297258 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:46:01.297258 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:46:01.297258 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:46:01.297258 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53bade32-e7bf-4ace-9b68-0458f257feff could not be found. Aug 24 13:46:01.297258 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:46:01.297258 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:46:01.297258 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:46:01.297258 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:46:01.297258 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:46:01.297258 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:46:01.297258 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:46:01.297258 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:46:01.297258 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:46:01.298695 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:46:01.298695 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:46:01.298695 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:46:01.298695 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:46:01.298695 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:46:01.298695 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:46:01.298695 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:46:01.298695 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53bade32-e7bf-4ace-9b68-0458f257feff could not be found. Aug 24 13:46:01.298695 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:46:01.298695 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:46:01.298695 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:46:01.298695 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:46:01.298695 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:46:01.298695 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:46:01.298695 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:46:01.298695 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:46:01.298695 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53bade32-e7bf-4ace-9b68-0458f257feff could not be found. Aug 24 13:46:01.298695 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:46:01.299924 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-7a8cf07e-b078-47a2-8524-608c80e22763 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] Returning 404 to user: Instance 53bade32-e7bf-4ace-9b68-0458f257feff could not be found. {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:46:01.299924 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-7a8cf07e-b078-47a2-8524-608c80e22763 tempest-AttachVolumeShelveTestJSON-1315367245 tempest-AttachVolumeShelveTestJSON-1315367245-project] 10.222.0.73 "GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff" status: 404 len: 111 microversion: 2.20 time: 0.031831 Aug 24 13:46:01.299924 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 458/901] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 13:46:01 2022] GET /compute/v2.1/servers/53bade32-e7bf-4ace-9b68-0458f257feff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 13:46:01.416082 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-26d981c0-d38d-4003-9d97-9f9f50a53520 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:46:01.425168 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-26d981c0-d38d-4003-9d97-9f9f50a53520 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6" status: 200 len: 1450 microversion: 2.1 time: 0.188572 Aug 24 13:46:01.425683 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 444/902] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:46:01 2022] GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 => generated 1450 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:46:04.151637 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-b2fa911d-810e-41cd-bea8-8d44c3dfcbe6 req-f5d012c4-78df-4f31-b333-381dd208c695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dba10a5-24cb-4641-914e-7558614f82a6", "tag": "ec946f8f-f434-42c3-90a3-60ce66ddf0c3"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:46:04.167812 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-b2fa911d-810e-41cd-bea8-8d44c3dfcbe6 req-f5d012c4-78df-4f31-b333-381dd208c695 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:04.170431 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-b2fa911d-810e-41cd-bea8-8d44c3dfcbe6 req-f5d012c4-78df-4f31-b333-381dd208c695 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:04.171407 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-b2fa911d-810e-41cd-bea8-8d44c3dfcbe6 req-f5d012c4-78df-4f31-b333-381dd208c695 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:04.199215 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-b2fa911d-810e-41cd-bea8-8d44c3dfcbe6 req-f5d012c4-78df-4f31-b333-381dd208c695 service nova] Creating event network-changed:ec946f8f-f434-42c3-90a3-60ce66ddf0c3 for instance 1dba10a5-24cb-4641-914e-7558614f82a6 on hv-cinder-77957 Aug 24 13:46:04.210153 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-b2fa911d-810e-41cd-bea8-8d44c3dfcbe6 req-f5d012c4-78df-4f31-b333-381dd208c695 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062327 Aug 24 13:46:04.212326 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 459/903] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:46:15.843167 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:46:15.844076 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:46:16.007370 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-000b9248-49f7-4dbb-b4d5-1a407a0c8c28 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Action: 'create', calling method: .version_select at 0x7f96c20ec280>, body: {"keypair": {"name": "tempest-keypair-1115932680", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+BHytjueNpWQv418Ifi5ZToeoPgg4CZN44o9QDZrlfBO7exFckBtQAMNzDlmCAjYj0cjaY/yLIDcJOEADVyliyRdJ9MGwy3kHS/73fU8XuiR8898EkCAmV6n+QsBzGVQ=="}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:46:16.025175 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-000b9248-49f7-4dbb-b4d5-1a407a0c8c28 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Getting quotas for project ca298d9092ad4a9489f1624d62b2ac1d. Resources: {'key_pairs'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:46:16.029350 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-000b9248-49f7-4dbb-b4d5-1a407a0c8c28 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Getting quotas for user 33835c5512df4c80a9b7cb9712a5904f and project ca298d9092ad4a9489f1624d62b2ac1d. Resources: {'key_pairs'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:46:16.104561 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-000b9248-49f7-4dbb-b4d5-1a407a0c8c28 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.267909 Aug 24 13:46:16.105307 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 445/904] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 13:46:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:46:18.624637 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:46:18.625433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=12 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:46:18.630041 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-ecfe99b4-59b0-40d6-a287-8683f613afa7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-38776035", "imageRef": "c520113c-3dae-4490-98bb-19fe3a46b66d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f3395214-009c-4aba-9dda-777a5c33eecb"}], "security_groups": [{"name": "tempest-securitygroup--795757273"}], "key_name": "tempest-keypair-1115932680", "user_data": "}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:46:18.764446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.network.neutron [None req-ecfe99b4-59b0-40d6-a287-8683f613afa7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] validate_networks() for [('f3395214-009c-4aba-9dda-777a5c33eecb', None, None, None, None, None)] {{(pid=133015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:46:19.564229 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-ecfe99b4-59b0-40d6-a287-8683f613afa7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Flavor limits 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:46:19.564990 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-ecfe99b4-59b0-40d6-a287-8683f613afa7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Image limits 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:46:19.565476 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-ecfe99b4-59b0-40d6-a287-8683f613afa7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Flavor pref 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:46:19.565891 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-ecfe99b4-59b0-40d6-a287-8683f613afa7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Image pref 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:46:19.566307 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-ecfe99b4-59b0-40d6-a287-8683f613afa7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:46:19.578859 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ecfe99b4-59b0-40d6-a287-8683f613afa7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:19.580385 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ecfe99b4-59b0-40d6-a287-8683f613afa7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:19.580385 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ecfe99b4-59b0-40d6-a287-8683f613afa7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:19.580590 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ecfe99b4-59b0-40d6-a287-8683f613afa7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:19.581174 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ecfe99b4-59b0-40d6-a287-8683f613afa7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:19.581674 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ecfe99b4-59b0-40d6-a287-8683f613afa7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:19.606131 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-ecfe99b4-59b0-40d6-a287-8683f613afa7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Getting quotas for project ca298d9092ad4a9489f1624d62b2ac1d. Resources: {'instances', 'cores', 'ram'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:46:19.611805 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-ecfe99b4-59b0-40d6-a287-8683f613afa7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Getting quotas for user 33835c5512df4c80a9b7cb9712a5904f and project ca298d9092ad4a9489f1624d62b2ac1d. Resources: {'instances', 'cores', 'ram'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:46:19.636409 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-ecfe99b4-59b0-40d6-a287-8683f613afa7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Going to run 1 instances... {{(pid=133015) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 13:46:19.639128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-ecfe99b4-59b0-40d6-a287-8683f613afa7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c520113c-3dae-4490-98bb-19fe3a46b66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 13:46:19.793847 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-ecfe99b4-59b0-40d6-a287-8683f613afa7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.170764 Aug 24 13:46:19.796942 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 460/905] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 13:46:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 13:46:19.810091 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-4b556668-dc2d-45a9-bb60-d6713ae06c4e tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:19.811501 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-4b556668-dc2d-45a9-bb60-d6713ae06c4e tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:19.897076 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-4b556668-dc2d-45a9-bb60-d6713ae06c4e tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:46:19.906862 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-4b556668-dc2d-45a9-bb60-d6713ae06c4e tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1236 microversion: 2.1 time: 0.101279 Aug 24 13:46:19.912614 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 446/906] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:46:19 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1236 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:46:20.931899 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-e218d113-5a1f-4b46-ade9-78be092ee797 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:20.932745 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-e218d113-5a1f-4b46-ade9-78be092ee797 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:21.014169 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-e218d113-5a1f-4b46-ade9-78be092ee797 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:46:21.022466 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-e218d113-5a1f-4b46-ade9-78be092ee797 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1236 microversion: 2.1 time: 0.095865 Aug 24 13:46:21.023057 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 461/907] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:46:20 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1236 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:46:22.043400 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-2f342a37-d47c-4e9d-a2d5-9d7db43b84f7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:22.044116 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-2f342a37-d47c-4e9d-a2d5-9d7db43b84f7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:22.052498 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2f342a37-d47c-4e9d-a2d5-9d7db43b84f7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:22.052996 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2f342a37-d47c-4e9d-a2d5-9d7db43b84f7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:22.053436 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2f342a37-d47c-4e9d-a2d5-9d7db43b84f7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:22.054211 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2f342a37-d47c-4e9d-a2d5-9d7db43b84f7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:22.054676 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2f342a37-d47c-4e9d-a2d5-9d7db43b84f7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:22.055099 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2f342a37-d47c-4e9d-a2d5-9d7db43b84f7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:22.118938 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-2f342a37-d47c-4e9d-a2d5-9d7db43b84f7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:46:22.126854 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-2f342a37-d47c-4e9d-a2d5-9d7db43b84f7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1288 microversion: 2.1 time: 0.087296 Aug 24 13:46:22.127427 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 447/908] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:46:22 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1288 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:46:23.149873 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-8534f8ee-6f89-4433-a7e4-a20f7c1fcf70 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:23.150528 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-8534f8ee-6f89-4433-a7e4-a20f7c1fcf70 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:23.157585 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8534f8ee-6f89-4433-a7e4-a20f7c1fcf70 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:23.158078 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8534f8ee-6f89-4433-a7e4-a20f7c1fcf70 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:23.158520 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8534f8ee-6f89-4433-a7e4-a20f7c1fcf70 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:23.159237 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8534f8ee-6f89-4433-a7e4-a20f7c1fcf70 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:23.164440 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8534f8ee-6f89-4433-a7e4-a20f7c1fcf70 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:23.164440 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8534f8ee-6f89-4433-a7e4-a20f7c1fcf70 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:23.227932 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-8534f8ee-6f89-4433-a7e4-a20f7c1fcf70 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:46:23.238501 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-8534f8ee-6f89-4433-a7e4-a20f7c1fcf70 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1294 microversion: 2.1 time: 0.093306 Aug 24 13:46:23.239855 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 462/909] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:46:23 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1294 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:46:24.263818 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-728a8ea5-a1ad-4928-8747-44d419b24c0a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:24.264442 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-728a8ea5-a1ad-4928-8747-44d419b24c0a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:24.271970 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-728a8ea5-a1ad-4928-8747-44d419b24c0a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:24.272481 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-728a8ea5-a1ad-4928-8747-44d419b24c0a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:24.272917 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-728a8ea5-a1ad-4928-8747-44d419b24c0a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:24.273614 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-728a8ea5-a1ad-4928-8747-44d419b24c0a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:24.274071 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-728a8ea5-a1ad-4928-8747-44d419b24c0a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:24.274494 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-728a8ea5-a1ad-4928-8747-44d419b24c0a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:24.425417 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-728a8ea5-a1ad-4928-8747-44d419b24c0a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:46:24.434285 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-728a8ea5-a1ad-4928-8747-44d419b24c0a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1361 microversion: 2.1 time: 0.174439 Aug 24 13:46:24.436453 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 448/910] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:46:24 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:46:24.811365 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-789298fa-7cb8-4313-a875-15b0f3f7dc1c req-d7bf3101-571c-4d7c-b6ad-fe8065c876a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31b97d61-96c0-459d-83c5-ebd1929f344a", "tag": "7197ae76-1beb-430e-a9cf-620230d08e49"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:46:24.824408 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-789298fa-7cb8-4313-a875-15b0f3f7dc1c req-d7bf3101-571c-4d7c-b6ad-fe8065c876a4 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:24.825311 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-789298fa-7cb8-4313-a875-15b0f3f7dc1c req-d7bf3101-571c-4d7c-b6ad-fe8065c876a4 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:24.825907 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-789298fa-7cb8-4313-a875-15b0f3f7dc1c req-d7bf3101-571c-4d7c-b6ad-fe8065c876a4 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:24.848319 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-789298fa-7cb8-4313-a875-15b0f3f7dc1c req-d7bf3101-571c-4d7c-b6ad-fe8065c876a4 service nova] Creating event network-changed:7197ae76-1beb-430e-a9cf-620230d08e49 for instance 31b97d61-96c0-459d-83c5-ebd1929f344a on hv-cinder-77957 Aug 24 13:46:24.854989 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-789298fa-7cb8-4313-a875-15b0f3f7dc1c req-d7bf3101-571c-4d7c-b6ad-fe8065c876a4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047211 Aug 24 13:46:24.857776 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 463/911] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:46:25.459828 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-9d3435fd-a458-4c76-8da3-d1d17d112d75 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:25.460479 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-9d3435fd-a458-4c76-8da3-d1d17d112d75 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:25.469771 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d3435fd-a458-4c76-8da3-d1d17d112d75 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:25.470664 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d3435fd-a458-4c76-8da3-d1d17d112d75 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:25.471440 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d3435fd-a458-4c76-8da3-d1d17d112d75 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:25.472730 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d3435fd-a458-4c76-8da3-d1d17d112d75 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:25.473523 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d3435fd-a458-4c76-8da3-d1d17d112d75 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:25.474900 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d3435fd-a458-4c76-8da3-d1d17d112d75 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:25.656808 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-9d3435fd-a458-4c76-8da3-d1d17d112d75 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:46:25.665553 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-9d3435fd-a458-4c76-8da3-d1d17d112d75 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1361 microversion: 2.1 time: 0.210329 Aug 24 13:46:25.666070 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 449/912] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:46:25 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:46:26.688659 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-202f20a2-94ae-4f48-baa8-3d78b5dff3ec tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:26.689376 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-202f20a2-94ae-4f48-baa8-3d78b5dff3ec tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:26.697207 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-202f20a2-94ae-4f48-baa8-3d78b5dff3ec tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:26.697709 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-202f20a2-94ae-4f48-baa8-3d78b5dff3ec tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:26.698155 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-202f20a2-94ae-4f48-baa8-3d78b5dff3ec tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:26.710319 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-202f20a2-94ae-4f48-baa8-3d78b5dff3ec tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:26.710319 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-202f20a2-94ae-4f48-baa8-3d78b5dff3ec tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:26.710319 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-202f20a2-94ae-4f48-baa8-3d78b5dff3ec tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:26.856837 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-202f20a2-94ae-4f48-baa8-3d78b5dff3ec tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:46:26.866246 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-202f20a2-94ae-4f48-baa8-3d78b5dff3ec tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1361 microversion: 2.1 time: 0.182110 Aug 24 13:46:26.866947 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 464/913] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:46:26 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:46:27.887981 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-60cfa26b-09ca-4bba-ac9c-a47e85846e9f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:27.888689 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-60cfa26b-09ca-4bba-ac9c-a47e85846e9f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:27.896122 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-60cfa26b-09ca-4bba-ac9c-a47e85846e9f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:27.897024 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-60cfa26b-09ca-4bba-ac9c-a47e85846e9f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:27.897524 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-60cfa26b-09ca-4bba-ac9c-a47e85846e9f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:27.898830 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-60cfa26b-09ca-4bba-ac9c-a47e85846e9f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:27.899942 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-60cfa26b-09ca-4bba-ac9c-a47e85846e9f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:27.900430 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-60cfa26b-09ca-4bba-ac9c-a47e85846e9f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:28.093128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-60cfa26b-09ca-4bba-ac9c-a47e85846e9f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:46:28.101398 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-60cfa26b-09ca-4bba-ac9c-a47e85846e9f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1361 microversion: 2.1 time: 0.217680 Aug 24 13:46:28.101992 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 450/914] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:46:27 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1361 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:46:29.126706 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-83acf7f2-9dc3-4771-82f0-aae31ef01f10 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:29.127808 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-83acf7f2-9dc3-4771-82f0-aae31ef01f10 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:29.138966 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-83acf7f2-9dc3-4771-82f0-aae31ef01f10 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:29.139699 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-83acf7f2-9dc3-4771-82f0-aae31ef01f10 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:29.140870 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-83acf7f2-9dc3-4771-82f0-aae31ef01f10 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:29.141983 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-83acf7f2-9dc3-4771-82f0-aae31ef01f10 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:29.142699 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-83acf7f2-9dc3-4771-82f0-aae31ef01f10 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:29.143349 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-83acf7f2-9dc3-4771-82f0-aae31ef01f10 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:29.317095 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-83acf7f2-9dc3-4771-82f0-aae31ef01f10 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:46:29.341169 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-83acf7f2-9dc3-4771-82f0-aae31ef01f10 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1361 microversion: 2.1 time: 0.210911 Aug 24 13:46:29.341847 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 465/915] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:46:29 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:46:30.367082 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-d74b52fd-2daf-481e-a7bf-4cd6f721d844 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:30.369531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-d74b52fd-2daf-481e-a7bf-4cd6f721d844 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:30.383940 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=6 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:46:30.393144 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d74b52fd-2daf-481e-a7bf-4cd6f721d844 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:30.395302 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d74b52fd-2daf-481e-a7bf-4cd6f721d844 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:30.396321 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d74b52fd-2daf-481e-a7bf-4cd6f721d844 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:30.398546 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d74b52fd-2daf-481e-a7bf-4cd6f721d844 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:30.399732 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d74b52fd-2daf-481e-a7bf-4cd6f721d844 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:30.400694 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d74b52fd-2daf-481e-a7bf-4cd6f721d844 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:30.707414 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-d74b52fd-2daf-481e-a7bf-4cd6f721d844 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:46:30.716892 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-d74b52fd-2daf-481e-a7bf-4cd6f721d844 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1361 microversion: 2.1 time: 0.357639 Aug 24 13:46:30.717771 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 451/916] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:46:30 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1361 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:46:31.741155 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-65c25734-6e23-4fd7-94d7-a98aaf43d798 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:31.741966 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-65c25734-6e23-4fd7-94d7-a98aaf43d798 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:31.744258 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=2 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:46:31.745663 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=8 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:46:31.752483 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-65c25734-6e23-4fd7-94d7-a98aaf43d798 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:31.753071 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-65c25734-6e23-4fd7-94d7-a98aaf43d798 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:31.753559 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-65c25734-6e23-4fd7-94d7-a98aaf43d798 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:31.754804 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-65c25734-6e23-4fd7-94d7-a98aaf43d798 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:31.754804 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-65c25734-6e23-4fd7-94d7-a98aaf43d798 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:31.755248 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-65c25734-6e23-4fd7-94d7-a98aaf43d798 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:31.987444 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-65c25734-6e23-4fd7-94d7-a98aaf43d798 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:46:31.996071 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-65c25734-6e23-4fd7-94d7-a98aaf43d798 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1361 microversion: 2.1 time: 0.259546 Aug 24 13:46:31.996968 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 466/917] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:46:31 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1361 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:46:33.033679 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-39c2f4f6-37cb-4699-80ac-b36cc52b2575 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:33.037013 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-39c2f4f6-37cb-4699-80ac-b36cc52b2575 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:33.052298 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-39c2f4f6-37cb-4699-80ac-b36cc52b2575 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:33.053697 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-39c2f4f6-37cb-4699-80ac-b36cc52b2575 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:33.055003 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-39c2f4f6-37cb-4699-80ac-b36cc52b2575 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:33.056574 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-39c2f4f6-37cb-4699-80ac-b36cc52b2575 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:33.058150 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-39c2f4f6-37cb-4699-80ac-b36cc52b2575 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:33.059222 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-39c2f4f6-37cb-4699-80ac-b36cc52b2575 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:33.428575 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-39c2f4f6-37cb-4699-80ac-b36cc52b2575 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:46:33.440532 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-39c2f4f6-37cb-4699-80ac-b36cc52b2575 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1361 microversion: 2.1 time: 0.424889 Aug 24 13:46:33.456708 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 452/918] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:46:33 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1361 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:46:34.466363 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-4693f75d-c4b0-4faf-a09b-b037090750ca tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:34.467326 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-4693f75d-c4b0-4faf-a09b-b037090750ca tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:34.479764 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4693f75d-c4b0-4faf-a09b-b037090750ca tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:34.480454 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4693f75d-c4b0-4faf-a09b-b037090750ca tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:34.481022 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4693f75d-c4b0-4faf-a09b-b037090750ca tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:34.481934 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4693f75d-c4b0-4faf-a09b-b037090750ca tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:34.482491 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4693f75d-c4b0-4faf-a09b-b037090750ca tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:34.483024 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4693f75d-c4b0-4faf-a09b-b037090750ca tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:34.736145 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4693f75d-c4b0-4faf-a09b-b037090750ca tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:46:34.751746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-4693f75d-c4b0-4faf-a09b-b037090750ca tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1361 microversion: 2.1 time: 0.291194 Aug 24 13:46:34.752708 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 467/919] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:46:34 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1361 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:46:35.249213 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-98eba762-1742-4e85-9727-8dda8be03252 req-22ce7e06-7358-4cf4-b0b9-c49216c56d7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b97d61-96c0-459d-83c5-ebd1929f344a", "name": "network-vif-plugged", "status": "completed", "tag": "7197ae76-1beb-430e-a9cf-620230d08e49"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:46:35.256912 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-98eba762-1742-4e85-9727-8dda8be03252 req-22ce7e06-7358-4cf4-b0b9-c49216c56d7f service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:35.257806 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-98eba762-1742-4e85-9727-8dda8be03252 req-22ce7e06-7358-4cf4-b0b9-c49216c56d7f service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:35.258776 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-98eba762-1742-4e85-9727-8dda8be03252 req-22ce7e06-7358-4cf4-b0b9-c49216c56d7f service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:35.275333 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-98eba762-1742-4e85-9727-8dda8be03252 req-22ce7e06-7358-4cf4-b0b9-c49216c56d7f service nova] Creating event network-vif-plugged:7197ae76-1beb-430e-a9cf-620230d08e49 for instance 31b97d61-96c0-459d-83c5-ebd1929f344a on hv-cinder-77957 Aug 24 13:46:35.282012 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-98eba762-1742-4e85-9727-8dda8be03252 req-22ce7e06-7358-4cf4-b0b9-c49216c56d7f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039276 Aug 24 13:46:35.288464 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 453/920] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:46:35.774755 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-72d4bf77-6c89-432f-b3da-0f8fe69a3377 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:35.775386 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-72d4bf77-6c89-432f-b3da-0f8fe69a3377 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:35.787440 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-72d4bf77-6c89-432f-b3da-0f8fe69a3377 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:35.787964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-72d4bf77-6c89-432f-b3da-0f8fe69a3377 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:35.788528 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-72d4bf77-6c89-432f-b3da-0f8fe69a3377 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:35.789271 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-72d4bf77-6c89-432f-b3da-0f8fe69a3377 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:35.789733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-72d4bf77-6c89-432f-b3da-0f8fe69a3377 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:35.790160 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-72d4bf77-6c89-432f-b3da-0f8fe69a3377 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:35.984778 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-72d4bf77-6c89-432f-b3da-0f8fe69a3377 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:46:35.993407 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-72d4bf77-6c89-432f-b3da-0f8fe69a3377 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1361 microversion: 2.1 time: 0.223282 Aug 24 13:46:35.994047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 468/921] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:46:35 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1361 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:46:37.017149 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-bd097811-b270-43de-b079-b220bc76d72b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:37.017862 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-bd097811-b270-43de-b079-b220bc76d72b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:37.033795 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd097811-b270-43de-b079-b220bc76d72b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:37.033795 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd097811-b270-43de-b079-b220bc76d72b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:37.033795 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd097811-b270-43de-b079-b220bc76d72b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:37.033795 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd097811-b270-43de-b079-b220bc76d72b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:37.034294 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd097811-b270-43de-b079-b220bc76d72b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:37.034294 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd097811-b270-43de-b079-b220bc76d72b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:37.225516 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-bd097811-b270-43de-b079-b220bc76d72b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:46:37.235132 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-bd097811-b270-43de-b079-b220bc76d72b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1361 microversion: 2.1 time: 0.224071 Aug 24 13:46:37.235937 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 454/922] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:46:37 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:46:38.265300 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-78b98e8d-70b0-4a27-b49e-18efc3c48d7c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:38.267170 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-78b98e8d-70b0-4a27-b49e-18efc3c48d7c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:38.274989 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-78b98e8d-70b0-4a27-b49e-18efc3c48d7c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:38.275954 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-78b98e8d-70b0-4a27-b49e-18efc3c48d7c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:38.275954 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-78b98e8d-70b0-4a27-b49e-18efc3c48d7c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:38.276645 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-78b98e8d-70b0-4a27-b49e-18efc3c48d7c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:38.277097 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-78b98e8d-70b0-4a27-b49e-18efc3c48d7c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:38.277522 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-78b98e8d-70b0-4a27-b49e-18efc3c48d7c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:38.619239 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-78b98e8d-70b0-4a27-b49e-18efc3c48d7c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:46:38.631685 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-78b98e8d-70b0-4a27-b49e-18efc3c48d7c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1547 microversion: 2.1 time: 0.370143 Aug 24 13:46:38.632317 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 469/923] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:46:38 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1547 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:46:38.654384 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-14655138-894b-428f-98ba-d2bc778a0fb3 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:38.655585 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-14655138-894b-428f-98ba-d2bc778a0fb3 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:38.662895 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-14655138-894b-428f-98ba-d2bc778a0fb3 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:38.663466 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-14655138-894b-428f-98ba-d2bc778a0fb3 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:38.663919 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-14655138-894b-428f-98ba-d2bc778a0fb3 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:38.664681 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-14655138-894b-428f-98ba-d2bc778a0fb3 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:38.665530 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-14655138-894b-428f-98ba-d2bc778a0fb3 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:38.665915 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-14655138-894b-428f-98ba-d2bc778a0fb3 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:38.858698 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-14655138-894b-428f-98ba-d2bc778a0fb3 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.208409 Aug 24 13:46:38.864825 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 455/924] 10.222.0.73 () {58 vars in 1275 bytes} [Wed Aug 24 13:46:38 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a/os-interface => generated 284 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:46:40.399865 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-a25cb392-3ca8-4d99-9182-ceaaa6df5f2b req-2ec3bbb5-398e-411c-b76e-e10d56d823ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31b97d61-96c0-459d-83c5-ebd1929f344a", "tag": "7197ae76-1beb-430e-a9cf-620230d08e49"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:46:40.414703 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-a25cb392-3ca8-4d99-9182-ceaaa6df5f2b req-2ec3bbb5-398e-411c-b76e-e10d56d823ea service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:40.420733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-a25cb392-3ca8-4d99-9182-ceaaa6df5f2b req-2ec3bbb5-398e-411c-b76e-e10d56d823ea service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:40.420733 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-a25cb392-3ca8-4d99-9182-ceaaa6df5f2b req-2ec3bbb5-398e-411c-b76e-e10d56d823ea service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:40.429959 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-a25cb392-3ca8-4d99-9182-ceaaa6df5f2b req-2ec3bbb5-398e-411c-b76e-e10d56d823ea service nova] Creating event network-changed:7197ae76-1beb-430e-a9cf-620230d08e49 for instance 31b97d61-96c0-459d-83c5-ebd1929f344a on hv-cinder-77957 Aug 24 13:46:40.437572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-a25cb392-3ca8-4d99-9182-ceaaa6df5f2b req-2ec3bbb5-398e-411c-b76e-e10d56d823ea service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042273 Aug 24 13:46:40.438772 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 470/925] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:46:55.615752 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:46:55.616641 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=48 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:46:55.620480 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-acf30f32-4b21-4fc2-864c-215a2b9c16ab tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Action: 'create', calling method: .version_select at 0x7f96c219c820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1238026471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtEk+oGkGlXZny+56IH0AwJBE2f6jRoqTMuZobW9WTFdDFY3HkekVvSPnCDq8K+zzBJT37+8jrdpcLyJJ7StpWQEJTY3n+lL1CmQ0s/DlW30JhkctCzbmxFDa0mbx+R2g=="}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:46:55.638962 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-acf30f32-4b21-4fc2-864c-215a2b9c16ab tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Getting quotas for project 6f61a8f100cf4d39928e4d596741e1bb. Resources: {'key_pairs'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:46:55.645064 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-acf30f32-4b21-4fc2-864c-215a2b9c16ab tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Getting quotas for user 63c0c061be824eae8d217d7ea32dcd92 and project 6f61a8f100cf4d39928e4d596741e1bb. Resources: {'key_pairs'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:46:55.705867 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-acf30f32-4b21-4fc2-864c-215a2b9c16ab tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.091510 Aug 24 13:46:55.706757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 456/926] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 13:46:55 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:46:55.727823 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-0b41dcbb-bcb2-4ac8-8b64-428a20994602 req-e329a4de-5bf6-4871-80ae-081d76343457 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1118fb04-6744-4b7c-b639-0081073ee53a", "tag": "579a6bec-e4ab-438a-a263-2fafa0fe42bc"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:46:55.729637 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-2e9a4f3a-33a6-4703-8abe-0227b50c8ab2 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:55.730274 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-2e9a4f3a-33a6-4703-8abe-0227b50c8ab2 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:55.733489 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:46:55.734257 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=48 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:46:55.741633 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2e9a4f3a-33a6-4703-8abe-0227b50c8ab2 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:55.741633 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2e9a4f3a-33a6-4703-8abe-0227b50c8ab2 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:55.741633 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2e9a4f3a-33a6-4703-8abe-0227b50c8ab2 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:55.741633 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2e9a4f3a-33a6-4703-8abe-0227b50c8ab2 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:55.742007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2e9a4f3a-33a6-4703-8abe-0227b50c8ab2 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:55.742086 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-0b41dcbb-bcb2-4ac8-8b64-428a20994602 req-e329a4de-5bf6-4871-80ae-081d76343457 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:55.742191 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2e9a4f3a-33a6-4703-8abe-0227b50c8ab2 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:55.742272 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-0b41dcbb-bcb2-4ac8-8b64-428a20994602 req-e329a4de-5bf6-4871-80ae-081d76343457 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:55.742272 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-0b41dcbb-bcb2-4ac8-8b64-428a20994602 req-e329a4de-5bf6-4871-80ae-081d76343457 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:55.760934 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-0b41dcbb-bcb2-4ac8-8b64-428a20994602 req-e329a4de-5bf6-4871-80ae-081d76343457 service nova] Creating event network-changed:579a6bec-e4ab-438a-a263-2fafa0fe42bc for instance 1118fb04-6744-4b7c-b639-0081073ee53a on hv-cinder-77957 Aug 24 13:46:55.767041 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-0b41dcbb-bcb2-4ac8-8b64-428a20994602 req-e329a4de-5bf6-4871-80ae-081d76343457 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042648 Aug 24 13:46:55.777011 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 471/927] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:46:55.777874 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-2e9a4f3a-33a6-4703-8abe-0227b50c8ab2 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Going to try to terminate instance {{(pid=133014) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 13:46:55.863232 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d6718e40-05a5-49e8-bf3a-661dc618ab3d tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2029302966", "imageRef": "1b1779b6-2909-4380-a75d-160f7ab75843", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1238026471", "networks": [{"uuid": "b8752123-78d7-4696-a283-4d3f0be721c2"}]}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:46:55.924073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.network.neutron [None req-d6718e40-05a5-49e8-bf3a-661dc618ab3d tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] validate_networks() for [('b8752123-78d7-4696-a283-4d3f0be721c2', None, None, None, None, None)] {{(pid=133015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:46:56.113661 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-2e9a4f3a-33a6-4703-8abe-0227b50c8ab2 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 204 len: 0 microversion: 2.1 time: 0.387640 Aug 24 13:46:56.120654 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 457/928] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:46:55 2022] DELETE /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:46:56.132557 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-5ff42a0d-9cb8-4abf-9814-d451efc54ac1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:56.132557 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-5ff42a0d-9cb8-4abf-9814-d451efc54ac1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:56.135562 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5ff42a0d-9cb8-4abf-9814-d451efc54ac1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:56.136065 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5ff42a0d-9cb8-4abf-9814-d451efc54ac1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:56.136537 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5ff42a0d-9cb8-4abf-9814-d451efc54ac1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:56.137247 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5ff42a0d-9cb8-4abf-9814-d451efc54ac1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:56.137709 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5ff42a0d-9cb8-4abf-9814-d451efc54ac1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:56.138135 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5ff42a0d-9cb8-4abf-9814-d451efc54ac1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:56.413758 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-5ff42a0d-9cb8-4abf-9814-d451efc54ac1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:46:56.422270 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-5ff42a0d-9cb8-4abf-9814-d451efc54ac1 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1570 microversion: 2.1 time: 0.299351 Aug 24 13:46:56.422867 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 458/929] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:46:56 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1570 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:46:56.527003 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-d6718e40-05a5-49e8-bf3a-661dc618ab3d tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Flavor limits 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:46:56.527542 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-d6718e40-05a5-49e8-bf3a-661dc618ab3d tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Image limits 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:46:56.528019 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-d6718e40-05a5-49e8-bf3a-661dc618ab3d tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Flavor pref 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:46:56.528454 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-d6718e40-05a5-49e8-bf3a-661dc618ab3d tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Image pref 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:46:56.528953 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-d6718e40-05a5-49e8-bf3a-661dc618ab3d tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:46:56.538462 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d6718e40-05a5-49e8-bf3a-661dc618ab3d tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:56.538941 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d6718e40-05a5-49e8-bf3a-661dc618ab3d tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:56.539397 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d6718e40-05a5-49e8-bf3a-661dc618ab3d tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:56.540097 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d6718e40-05a5-49e8-bf3a-661dc618ab3d tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:56.540587 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d6718e40-05a5-49e8-bf3a-661dc618ab3d tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:56.541013 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d6718e40-05a5-49e8-bf3a-661dc618ab3d tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:56.558960 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-d6718e40-05a5-49e8-bf3a-661dc618ab3d tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Getting quotas for project 6f61a8f100cf4d39928e4d596741e1bb. Resources: {'instances', 'cores', 'ram'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:46:56.567665 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-d6718e40-05a5-49e8-bf3a-661dc618ab3d tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Getting quotas for user 63c0c061be824eae8d217d7ea32dcd92 and project 6f61a8f100cf4d39928e4d596741e1bb. Resources: {'instances', 'cores', 'ram'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:46:56.580226 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-d6718e40-05a5-49e8-bf3a-661dc618ab3d tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Going to run 1 instances... {{(pid=133015) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 13:46:56.583747 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-d6718e40-05a5-49e8-bf3a-661dc618ab3d tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1b1779b6-2909-4380-a75d-160f7ab75843',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 13:46:56.747106 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-d6718e40-05a5-49e8-bf3a-661dc618ab3d tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.886712 Aug 24 13:46:56.747106 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 472/930] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 13:46:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 13:46:56.760641 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-d658bcaf-f800-407a-923d-d07c80ef0ed8 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:56.761253 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-d658bcaf-f800-407a-923d-d07c80ef0ed8 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:56.830335 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-d658bcaf-f800-407a-923d-d07c80ef0ed8 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:46:56.842534 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-d658bcaf-f800-407a-923d-d07c80ef0ed8 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1259 microversion: 2.1 time: 0.085664 Aug 24 13:46:56.843353 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 459/931] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:46:56 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1259 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:46:57.443758 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-4ca035de-1590-477f-8935-8e98c4d0895e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:57.444519 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-4ca035de-1590-477f-8935-8e98c4d0895e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:57.451825 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4ca035de-1590-477f-8935-8e98c4d0895e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:57.452354 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4ca035de-1590-477f-8935-8e98c4d0895e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:57.453365 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4ca035de-1590-477f-8935-8e98c4d0895e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:57.453801 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4ca035de-1590-477f-8935-8e98c4d0895e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:57.454273 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4ca035de-1590-477f-8935-8e98c4d0895e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:57.454675 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4ca035de-1590-477f-8935-8e98c4d0895e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:57.637932 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4ca035de-1590-477f-8935-8e98c4d0895e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:46:57.647402 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-4ca035de-1590-477f-8935-8e98c4d0895e tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1570 microversion: 2.1 time: 0.207989 Aug 24 13:46:57.648256 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 473/932] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:46:57 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1570 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:46:57.864947 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-cb6c93be-2217-498d-a437-134832510693 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:57.865921 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-cb6c93be-2217-498d-a437-134832510693 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:57.945661 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-cb6c93be-2217-498d-a437-134832510693 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:46:57.955485 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-cb6c93be-2217-498d-a437-134832510693 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1259 microversion: 2.1 time: 0.094825 Aug 24 13:46:57.956365 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 460/933] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:46:57 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1259 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:46:58.674131 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-6942faa6-428d-4f94-b18e-3e3891cd033f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:58.676785 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-6942faa6-428d-4f94-b18e-3e3891cd033f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:58.690324 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6942faa6-428d-4f94-b18e-3e3891cd033f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:58.691683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6942faa6-428d-4f94-b18e-3e3891cd033f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:58.693254 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6942faa6-428d-4f94-b18e-3e3891cd033f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:58.694341 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6942faa6-428d-4f94-b18e-3e3891cd033f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:58.695158 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6942faa6-428d-4f94-b18e-3e3891cd033f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:58.695979 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6942faa6-428d-4f94-b18e-3e3891cd033f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:58.906502 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-6942faa6-428d-4f94-b18e-3e3891cd033f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:46:58.916045 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-6942faa6-428d-4f94-b18e-3e3891cd033f tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1451 microversion: 2.1 time: 0.248768 Aug 24 13:46:58.916744 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 474/934] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:46:58 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1451 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:46:58.985636 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-d9e32648-3fdd-48cc-a7f6-90b21e0e1b06 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:58.985636 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-d9e32648-3fdd-48cc-a7f6-90b21e0e1b06 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:58.996052 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d9e32648-3fdd-48cc-a7f6-90b21e0e1b06 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:58.996675 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d9e32648-3fdd-48cc-a7f6-90b21e0e1b06 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:58.997183 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d9e32648-3fdd-48cc-a7f6-90b21e0e1b06 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:58.997961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d9e32648-3fdd-48cc-a7f6-90b21e0e1b06 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:58.998654 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d9e32648-3fdd-48cc-a7f6-90b21e0e1b06 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:58.999194 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d9e32648-3fdd-48cc-a7f6-90b21e0e1b06 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:59.083201 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-48623d8f-1c00-45a9-9488-88e164ad284e req-a7423580-8218-47b5-a043-ad352e25da7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1118fb04-6744-4b7c-b639-0081073ee53a", "name": "network-vif-deleted", "tag": "579a6bec-e4ab-438a-a263-2fafa0fe42bc"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:46:59.092066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-d9e32648-3fdd-48cc-a7f6-90b21e0e1b06 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:46:59.100479 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-48623d8f-1c00-45a9-9488-88e164ad284e req-a7423580-8218-47b5-a043-ad352e25da7b service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:59.102036 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-48623d8f-1c00-45a9-9488-88e164ad284e req-a7423580-8218-47b5-a043-ad352e25da7b service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:59.102158 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-48623d8f-1c00-45a9-9488-88e164ad284e req-a7423580-8218-47b5-a043-ad352e25da7b service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:59.109464 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-d9e32648-3fdd-48cc-a7f6-90b21e0e1b06 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1255 microversion: 2.1 time: 0.127606 Aug 24 13:46:59.110303 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 461/935] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:46:58 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1255 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:46:59.129959 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-48623d8f-1c00-45a9-9488-88e164ad284e req-a7423580-8218-47b5-a043-ad352e25da7b service nova] Creating event network-vif-deleted:579a6bec-e4ab-438a-a263-2fafa0fe42bc for instance 1118fb04-6744-4b7c-b639-0081073ee53a on hv-cinder-77957 Aug 24 13:46:59.136228 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-48623d8f-1c00-45a9-9488-88e164ad284e req-a7423580-8218-47b5-a043-ad352e25da7b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062501 Aug 24 13:46:59.137156 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 475/936] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:46:59.938839 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-60908912-aa61-4a90-a4d2-a79174621632 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:46:59.939597 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-60908912-aa61-4a90-a4d2-a79174621632 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:46:59.947127 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-60908912-aa61-4a90-a4d2-a79174621632 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:59.947621 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-60908912-aa61-4a90-a4d2-a79174621632 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:59.948056 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-60908912-aa61-4a90-a4d2-a79174621632 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:46:59.948792 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-60908912-aa61-4a90-a4d2-a79174621632 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:46:59.949246 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-60908912-aa61-4a90-a4d2-a79174621632 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:46:59.949757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-60908912-aa61-4a90-a4d2-a79174621632 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:00.030426 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-60908912-aa61-4a90-a4d2-a79174621632 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:00.041798 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-60908912-aa61-4a90-a4d2-a79174621632 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1219 microversion: 2.1 time: 0.107179 Aug 24 13:47:00.042636 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 462/937] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:46:59 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:00.140119 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-9757f9ed-bee1-4450-b3c9-2c633103ae95 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:00.140851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-9757f9ed-bee1-4450-b3c9-2c633103ae95 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:00.147485 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9757f9ed-bee1-4450-b3c9-2c633103ae95 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:00.147969 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9757f9ed-bee1-4450-b3c9-2c633103ae95 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:00.148505 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9757f9ed-bee1-4450-b3c9-2c633103ae95 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:00.149277 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9757f9ed-bee1-4450-b3c9-2c633103ae95 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:00.149727 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9757f9ed-bee1-4450-b3c9-2c633103ae95 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:00.150148 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9757f9ed-bee1-4450-b3c9-2c633103ae95 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:00.261874 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-9757f9ed-bee1-4450-b3c9-2c633103ae95 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:00.270337 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-9757f9ed-bee1-4450-b3c9-2c633103ae95 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1319 microversion: 2.1 time: 0.134808 Aug 24 13:47:00.271995 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 476/938] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:00 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1319 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:01.066068 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-996ba2c8-f796-4a3d-aa19-3127bc90e257 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:01.068507 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-996ba2c8-f796-4a3d-aa19-3127bc90e257 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:01.082373 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-996ba2c8-f796-4a3d-aa19-3127bc90e257 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:01.084315 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-996ba2c8-f796-4a3d-aa19-3127bc90e257 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:01.084871 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-996ba2c8-f796-4a3d-aa19-3127bc90e257 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:01.086402 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-996ba2c8-f796-4a3d-aa19-3127bc90e257 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:01.087312 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-996ba2c8-f796-4a3d-aa19-3127bc90e257 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:01.087911 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-996ba2c8-f796-4a3d-aa19-3127bc90e257 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:01.140108 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-996ba2c8-f796-4a3d-aa19-3127bc90e257 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:01.140638 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-996ba2c8-f796-4a3d-aa19-3127bc90e257 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:01.141259 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-996ba2c8-f796-4a3d-aa19-3127bc90e257 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:01.141979 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.objects.instance [None req-996ba2c8-f796-4a3d-aa19-3127bc90e257 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lazy-loading 'fault' on Instance uuid 1118fb04-6744-4b7c-b639-0081073ee53a {{(pid=133014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:47:01.212288 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-996ba2c8-f796-4a3d-aa19-3127bc90e257 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2730741d853a4cfcab1bbc990cf42611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcafe839dec4fcc95a4c720463483ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:01.227745 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-996ba2c8-f796-4a3d-aa19-3127bc90e257 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 200 len: 1178 microversion: 2.1 time: 0.167112 Aug 24 13:47:01.228960 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 463/939] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:01 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 1178 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:01.322905 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-99425042-5094-430e-9d1d-2f85909d65c2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:01.322905 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-99425042-5094-430e-9d1d-2f85909d65c2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:01.335524 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-99425042-5094-430e-9d1d-2f85909d65c2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:01.336027 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-99425042-5094-430e-9d1d-2f85909d65c2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:01.337131 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-99425042-5094-430e-9d1d-2f85909d65c2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:01.337877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-99425042-5094-430e-9d1d-2f85909d65c2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:01.338411 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-99425042-5094-430e-9d1d-2f85909d65c2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:01.338984 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-99425042-5094-430e-9d1d-2f85909d65c2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:01.434019 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-99425042-5094-430e-9d1d-2f85909d65c2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:01.444892 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-99425042-5094-430e-9d1d-2f85909d65c2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1317 microversion: 2.1 time: 0.132977 Aug 24 13:47:01.445574 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 477/940] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:01 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1317 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:02.254456 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e9ebc89e-462a-4da9-b5a1-b2df20c5c374 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:02.255027 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-e9ebc89e-462a-4da9-b5a1-b2df20c5c374 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] [instance: 1118fb04-6744-4b7c-b639-0081073ee53a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:02.263324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e9ebc89e-462a-4da9-b5a1-b2df20c5c374 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:02.263830 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e9ebc89e-462a-4da9-b5a1-b2df20c5c374 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:02.264333 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e9ebc89e-462a-4da9-b5a1-b2df20c5c374 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:02.265275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e9ebc89e-462a-4da9-b5a1-b2df20c5c374 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:02.265972 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e9ebc89e-462a-4da9-b5a1-b2df20c5c374 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:02.266714 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e9ebc89e-462a-4da9-b5a1-b2df20c5c374 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:02.283566 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-e9ebc89e-462a-4da9-b5a1-b2df20c5c374 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] HTTP exception thrown: Instance 1118fb04-6744-4b7c-b639-0081073ee53a could not be found. Aug 24 13:47:02.285295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e9ebc89e-462a-4da9-b5a1-b2df20c5c374 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Request method failure captured: Aug 24 13:47:02.285295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a HTTP/1.1 Aug 24 13:47:02.285295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:47:02.285295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:47:02.285295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:47:02.285295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:47:02.285295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:47:02.285295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:47:02.285295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:47:02.285295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:47:02.285295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBipd58hGvtdPXF1fCJW-gV37fkwhe9oZasWUhgwB1Uui0zX6h7e3VgGdfxamhA8hgmWf31-uE8g_LYZS1WNL4LlFEkk7R8bdMG8P6rte-x8joQShQrqUBdnt1VgzHUI-RLnDxw9QQIrmOtnMM2vG4AmYdM5RCnq05nxcaM-Qs00WANI Aug 24 13:47:02.285295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:47:02.285295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:47:02.285295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:47:02.285295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:47:02.285295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:47:02.285295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:47:02.285295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 6bcafe839dec4fcc95a4c720463483ba Aug 24 13:47:02.285295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-TestShelveInstance-1034388593 Aug 24 13:47:02.285295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:47:02.285295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:47:02.288361 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6bcafe839dec4fcc95a4c720463483ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6bcafe839dec4fcc95a4c720463483ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6bcafe839dec4fcc95a4c720463483ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6bcafe839dec4fcc95a4c720463483ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:47:02.288361 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-TestShelveInstance-1034388593 Aug 24 13:47:02.288361 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 6bcafe839dec4fcc95a4c720463483ba Aug 24 13:47:02.288361 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-TestShelveInstance-1034388593 Aug 24 13:47:02.288361 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-TestShelveInstance-1034388593-project Aug 24 13:47:02.288361 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:47:02.288361 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:47:02.288361 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: 2730741d853a4cfcab1bbc990cf42611 Aug 24 13:47:02.288361 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-TestShelveInstance-1034388593-project Aug 24 13:47:02.288361 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:47:02.288361 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Instance 1118fb04-6744-4b7c-b639-0081073ee53a could not be found. Aug 24 13:47:02.288361 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': '1118fb04-6744-4b7c-b639-0081073ee53a'} Aug 24 13:47:02.289702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:47:02.289702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:47:02.289702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:47:02.289702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:47:02.289702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:47:02.289702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:47:02.289702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:47:02.289702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:47:02.289702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:47:02.289702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:47:02.289702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1118fb04-6744-4b7c-b639-0081073ee53a could not be found. Aug 24 13:47:02.289702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:47:02.289702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:47:02.289702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:47:02.289702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:47:02.289702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:47:02.289702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:47:02.289702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:47:02.289702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:47:02.289702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:47:02.291544 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:47:02.291544 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:47:02.291544 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:47:02.291544 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:47:02.291544 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:47:02.291544 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:47:02.291544 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:47:02.291544 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1118fb04-6744-4b7c-b639-0081073ee53a could not be found. Aug 24 13:47:02.291544 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:47:02.291544 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:47:02.291544 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:47:02.291544 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:47:02.291544 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:47:02.291544 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:47:02.291544 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:47:02.291544 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:47:02.291544 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1118fb04-6744-4b7c-b639-0081073ee53a could not be found. Aug 24 13:47:02.291544 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:47:02.293967 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e9ebc89e-462a-4da9-b5a1-b2df20c5c374 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Returning 404 to user: Instance 1118fb04-6744-4b7c-b639-0081073ee53a could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:47:02.293967 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-e9ebc89e-462a-4da9-b5a1-b2df20c5c374 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a" status: 404 len: 111 microversion: 2.1 time: 0.038097 Aug 24 13:47:02.293967 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 464/941] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:02 2022] GET /compute/v2.1/servers/1118fb04-6744-4b7c-b639-0081073ee53a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:47:02.470100 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-053ce4c6-e1a3-43a6-8aa0-2bba6f68d232 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:02.471618 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-053ce4c6-e1a3-43a6-8aa0-2bba6f68d232 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:02.485753 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-053ce4c6-e1a3-43a6-8aa0-2bba6f68d232 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:02.486680 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-053ce4c6-e1a3-43a6-8aa0-2bba6f68d232 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:02.487292 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-053ce4c6-e1a3-43a6-8aa0-2bba6f68d232 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:02.488463 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-053ce4c6-e1a3-43a6-8aa0-2bba6f68d232 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:02.489123 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-053ce4c6-e1a3-43a6-8aa0-2bba6f68d232 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:02.489859 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-053ce4c6-e1a3-43a6-8aa0-2bba6f68d232 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:02.607337 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-c6853eb3-307f-4d0a-a60b-0664a1b4d0b4 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] Calling method '.version_select at 0x7f96c2b26790>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:02.716567 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-053ce4c6-e1a3-43a6-8aa0-2bba6f68d232 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:02.739524 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-053ce4c6-e1a3-43a6-8aa0-2bba6f68d232 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1359 microversion: 2.1 time: 0.274784 Aug 24 13:47:02.740427 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 478/942] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:02 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1359 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:02.777835 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-c6853eb3-307f-4d0a-a60b-0664a1b4d0b4 tempest-TestShelveInstance-1034388593 tempest-TestShelveInstance-1034388593-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1608228831" status: 202 len: 0 microversion: 2.1 time: 0.177355 Aug 24 13:47:02.779015 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 465/943] 10.222.0.73 () {58 vars in 1254 bytes} [Wed Aug 24 13:47:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1608228831 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:47:03.763118 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a555262b-cc07-4566-a262-84dc92e8603f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:03.764368 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-a555262b-cc07-4566-a262-84dc92e8603f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:03.771361 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a555262b-cc07-4566-a262-84dc92e8603f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:03.772139 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a555262b-cc07-4566-a262-84dc92e8603f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:03.772755 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a555262b-cc07-4566-a262-84dc92e8603f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:03.773685 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a555262b-cc07-4566-a262-84dc92e8603f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:03.774301 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a555262b-cc07-4566-a262-84dc92e8603f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:03.774882 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a555262b-cc07-4566-a262-84dc92e8603f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:03.960166 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-a555262b-cc07-4566-a262-84dc92e8603f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:03.972337 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a555262b-cc07-4566-a262-84dc92e8603f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1359 microversion: 2.1 time: 0.210380 Aug 24 13:47:03.982024 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 479/944] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:03 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:05.008040 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-2ba9e3d3-5c40-456b-bae3-f66c5c0a69a6 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:05.016027 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-2ba9e3d3-5c40-456b-bae3-f66c5c0a69a6 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:05.025599 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2ba9e3d3-5c40-456b-bae3-f66c5c0a69a6 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:05.026470 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2ba9e3d3-5c40-456b-bae3-f66c5c0a69a6 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:05.027115 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2ba9e3d3-5c40-456b-bae3-f66c5c0a69a6 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:05.028810 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2ba9e3d3-5c40-456b-bae3-f66c5c0a69a6 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:05.030039 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2ba9e3d3-5c40-456b-bae3-f66c5c0a69a6 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:05.041788 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2ba9e3d3-5c40-456b-bae3-f66c5c0a69a6 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:05.338409 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-2ba9e3d3-5c40-456b-bae3-f66c5c0a69a6 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:05.346375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-2ba9e3d3-5c40-456b-bae3-f66c5c0a69a6 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1359 microversion: 2.1 time: 0.346489 Aug 24 13:47:05.356536 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 466/945] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:04 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1359 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:06.372010 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-9b6d4fe8-336e-46fd-aa31-7f9b605901d1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:06.374143 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-9b6d4fe8-336e-46fd-aa31-7f9b605901d1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:06.381270 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9b6d4fe8-336e-46fd-aa31-7f9b605901d1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:06.381866 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9b6d4fe8-336e-46fd-aa31-7f9b605901d1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:06.382402 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9b6d4fe8-336e-46fd-aa31-7f9b605901d1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:06.386628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9b6d4fe8-336e-46fd-aa31-7f9b605901d1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:06.392148 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9b6d4fe8-336e-46fd-aa31-7f9b605901d1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:06.392148 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9b6d4fe8-336e-46fd-aa31-7f9b605901d1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:06.548795 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=2 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:47:06.575633 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=6 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:47:06.596105 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-9b6d4fe8-336e-46fd-aa31-7f9b605901d1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:06.611916 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-9b6d4fe8-336e-46fd-aa31-7f9b605901d1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1359 microversion: 2.1 time: 0.244396 Aug 24 13:47:06.625245 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 480/946] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:06 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1359 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:07.634398 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-7a0fa1fc-638d-4282-9074-b1b4dc1551c8 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:07.635026 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-7a0fa1fc-638d-4282-9074-b1b4dc1551c8 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:07.642080 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7a0fa1fc-638d-4282-9074-b1b4dc1551c8 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:07.642835 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7a0fa1fc-638d-4282-9074-b1b4dc1551c8 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:07.643248 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7a0fa1fc-638d-4282-9074-b1b4dc1551c8 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:07.644064 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7a0fa1fc-638d-4282-9074-b1b4dc1551c8 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:07.644735 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7a0fa1fc-638d-4282-9074-b1b4dc1551c8 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:07.645349 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7a0fa1fc-638d-4282-9074-b1b4dc1551c8 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:07.901228 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-7a0fa1fc-638d-4282-9074-b1b4dc1551c8 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:07.911447 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-7a0fa1fc-638d-4282-9074-b1b4dc1551c8 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1359 microversion: 2.1 time: 0.281272 Aug 24 13:47:07.924622 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 467/947] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:07 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1359 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:08.940745 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-db41387a-f270-430f-9b90-55f23c37385e tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:08.943611 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-db41387a-f270-430f-9b90-55f23c37385e tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:08.958861 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-db41387a-f270-430f-9b90-55f23c37385e tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:08.960306 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-db41387a-f270-430f-9b90-55f23c37385e tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:08.961406 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-db41387a-f270-430f-9b90-55f23c37385e tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:08.963341 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-db41387a-f270-430f-9b90-55f23c37385e tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:08.964572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-db41387a-f270-430f-9b90-55f23c37385e tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:08.965412 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-db41387a-f270-430f-9b90-55f23c37385e tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:09.236206 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-db41387a-f270-430f-9b90-55f23c37385e tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:09.246956 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-db41387a-f270-430f-9b90-55f23c37385e tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1359 microversion: 2.1 time: 0.316511 Aug 24 13:47:09.248152 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 481/948] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:08 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1359 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:10.268833 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-665addb9-e299-424d-8455-88bc4211852a tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:10.269607 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-665addb9-e299-424d-8455-88bc4211852a tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:10.272441 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=8 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:47:10.278545 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-665addb9-e299-424d-8455-88bc4211852a tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:10.279171 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-665addb9-e299-424d-8455-88bc4211852a tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:10.279682 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-665addb9-e299-424d-8455-88bc4211852a tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:10.280575 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-665addb9-e299-424d-8455-88bc4211852a tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:10.281097 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-665addb9-e299-424d-8455-88bc4211852a tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:10.290035 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-665addb9-e299-424d-8455-88bc4211852a tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:10.448856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-665addb9-e299-424d-8455-88bc4211852a tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:10.456787 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-665addb9-e299-424d-8455-88bc4211852a tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1359 microversion: 2.1 time: 0.192077 Aug 24 13:47:10.457373 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 468/949] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:10 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:11.478259 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-5ed2eecc-4167-4171-8dee-dede084aee59 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:11.479000 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-5ed2eecc-4167-4171-8dee-dede084aee59 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:11.485706 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5ed2eecc-4167-4171-8dee-dede084aee59 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:11.486281 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5ed2eecc-4167-4171-8dee-dede084aee59 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:11.486789 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5ed2eecc-4167-4171-8dee-dede084aee59 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:11.487579 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5ed2eecc-4167-4171-8dee-dede084aee59 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:11.488115 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5ed2eecc-4167-4171-8dee-dede084aee59 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:11.488634 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5ed2eecc-4167-4171-8dee-dede084aee59 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:11.887085 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-5ed2eecc-4167-4171-8dee-dede084aee59 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:11.896202 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-5ed2eecc-4167-4171-8dee-dede084aee59 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1359 microversion: 2.1 time: 0.421798 Aug 24 13:47:11.896830 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 482/950] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:11 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1359 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:12.191058 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-26d30f45-00da-49c6-9896-0cb9fedea6a2 req-d28f598c-6c14-465f-98fe-2b55e6871026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d1d1e2a-ddc9-4a66-8db4-6cccea722024", "tag": "918b2634-4141-429d-95ff-f9bae50b39dc"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:47:12.201483 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-26d30f45-00da-49c6-9896-0cb9fedea6a2 req-d28f598c-6c14-465f-98fe-2b55e6871026 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:12.202141 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-26d30f45-00da-49c6-9896-0cb9fedea6a2 req-d28f598c-6c14-465f-98fe-2b55e6871026 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:12.202576 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-26d30f45-00da-49c6-9896-0cb9fedea6a2 req-d28f598c-6c14-465f-98fe-2b55e6871026 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:12.214456 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-26d30f45-00da-49c6-9896-0cb9fedea6a2 req-d28f598c-6c14-465f-98fe-2b55e6871026 service nova] Creating event network-changed:918b2634-4141-429d-95ff-f9bae50b39dc for instance 5d1d1e2a-ddc9-4a66-8db4-6cccea722024 on hv-cinder-77957 Aug 24 13:47:12.219823 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-26d30f45-00da-49c6-9896-0cb9fedea6a2 req-d28f598c-6c14-465f-98fe-2b55e6871026 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032703 Aug 24 13:47:12.220514 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 469/951] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:47:12.919912 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-6bec0664-5999-40b4-a0ec-ce3041a49e25 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:12.921418 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-6bec0664-5999-40b4-a0ec-ce3041a49e25 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:12.929600 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6bec0664-5999-40b4-a0ec-ce3041a49e25 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:12.930438 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6bec0664-5999-40b4-a0ec-ce3041a49e25 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:12.931110 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6bec0664-5999-40b4-a0ec-ce3041a49e25 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:12.932066 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6bec0664-5999-40b4-a0ec-ce3041a49e25 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:12.932756 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6bec0664-5999-40b4-a0ec-ce3041a49e25 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:12.933432 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6bec0664-5999-40b4-a0ec-ce3041a49e25 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:13.328429 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-6bec0664-5999-40b4-a0ec-ce3041a49e25 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:13.337702 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-6bec0664-5999-40b4-a0ec-ce3041a49e25 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1359 microversion: 2.1 time: 0.421443 Aug 24 13:47:13.338308 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 483/952] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:12 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1359 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:14.360709 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-fc5a17eb-fb93-42b1-9ac3-2bf460d9bbb5 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:14.361548 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-fc5a17eb-fb93-42b1-9ac3-2bf460d9bbb5 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:14.369128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fc5a17eb-fb93-42b1-9ac3-2bf460d9bbb5 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:14.369659 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fc5a17eb-fb93-42b1-9ac3-2bf460d9bbb5 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:14.370172 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fc5a17eb-fb93-42b1-9ac3-2bf460d9bbb5 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:14.370876 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fc5a17eb-fb93-42b1-9ac3-2bf460d9bbb5 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:14.371502 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fc5a17eb-fb93-42b1-9ac3-2bf460d9bbb5 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:14.372620 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fc5a17eb-fb93-42b1-9ac3-2bf460d9bbb5 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:14.522373 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-fc5a17eb-fb93-42b1-9ac3-2bf460d9bbb5 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:14.530034 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-fc5a17eb-fb93-42b1-9ac3-2bf460d9bbb5 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1359 microversion: 2.1 time: 0.174052 Aug 24 13:47:14.530750 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 470/953] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:14 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:15.554304 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-22cb223f-744e-4e24-938c-56f78b3bc62e tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:15.555155 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-22cb223f-744e-4e24-938c-56f78b3bc62e tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:15.561956 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-22cb223f-744e-4e24-938c-56f78b3bc62e tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:15.562542 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-22cb223f-744e-4e24-938c-56f78b3bc62e tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:15.562985 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-22cb223f-744e-4e24-938c-56f78b3bc62e tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:15.563704 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-22cb223f-744e-4e24-938c-56f78b3bc62e tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:15.564162 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-22cb223f-744e-4e24-938c-56f78b3bc62e tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:15.564612 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-22cb223f-744e-4e24-938c-56f78b3bc62e tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:15.784750 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-22cb223f-744e-4e24-938c-56f78b3bc62e tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:15.794244 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-22cb223f-744e-4e24-938c-56f78b3bc62e tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1359 microversion: 2.1 time: 0.246771 Aug 24 13:47:15.795122 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 484/954] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:15 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1359 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:16.816276 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-f4ed3ec4-43c4-47b0-b20f-91475ea6a10b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:16.817349 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-f4ed3ec4-43c4-47b0-b20f-91475ea6a10b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:16.828047 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f4ed3ec4-43c4-47b0-b20f-91475ea6a10b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:16.828726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f4ed3ec4-43c4-47b0-b20f-91475ea6a10b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:16.829094 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f4ed3ec4-43c4-47b0-b20f-91475ea6a10b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:16.829811 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f4ed3ec4-43c4-47b0-b20f-91475ea6a10b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:16.830300 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f4ed3ec4-43c4-47b0-b20f-91475ea6a10b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:16.830733 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f4ed3ec4-43c4-47b0-b20f-91475ea6a10b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:16.985694 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-f4ed3ec4-43c4-47b0-b20f-91475ea6a10b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:16.994821 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-f4ed3ec4-43c4-47b0-b20f-91475ea6a10b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1359 microversion: 2.1 time: 0.182651 Aug 24 13:47:16.995095 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 471/955] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:16 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:17.282693 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-6fc909a9-27a2-4e83-b7b8-ec2ef5e3f5c1 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:17.282693 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-6fc909a9-27a2-4e83-b7b8-ec2ef5e3f5c1 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:17.288095 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6fc909a9-27a2-4e83-b7b8-ec2ef5e3f5c1 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:17.288594 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6fc909a9-27a2-4e83-b7b8-ec2ef5e3f5c1 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:17.289037 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6fc909a9-27a2-4e83-b7b8-ec2ef5e3f5c1 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:17.289746 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6fc909a9-27a2-4e83-b7b8-ec2ef5e3f5c1 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:17.290203 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6fc909a9-27a2-4e83-b7b8-ec2ef5e3f5c1 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:17.290634 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6fc909a9-27a2-4e83-b7b8-ec2ef5e3f5c1 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:17.317932 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-6fc909a9-27a2-4e83-b7b8-ec2ef5e3f5c1 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a/ips" status: 200 len: 145 microversion: 2.1 time: 0.040318 Aug 24 13:47:17.318631 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 485/956] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 13:47:17 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:47:17.376753 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-7b6dbb82-a8f9-4a87-94eb-b991592febfa req-bd39987d-54f3-443c-95fc-ae990c006998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d1d1e2a-ddc9-4a66-8db4-6cccea722024", "name": "network-vif-plugged", "status": "completed", "tag": "918b2634-4141-429d-95ff-f9bae50b39dc"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:47:17.388526 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-7b6dbb82-a8f9-4a87-94eb-b991592febfa req-bd39987d-54f3-443c-95fc-ae990c006998 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:17.389078 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-7b6dbb82-a8f9-4a87-94eb-b991592febfa req-bd39987d-54f3-443c-95fc-ae990c006998 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:17.389592 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-7b6dbb82-a8f9-4a87-94eb-b991592febfa req-bd39987d-54f3-443c-95fc-ae990c006998 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:17.401511 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-7b6dbb82-a8f9-4a87-94eb-b991592febfa req-bd39987d-54f3-443c-95fc-ae990c006998 service nova] Creating event network-vif-plugged:918b2634-4141-429d-95ff-f9bae50b39dc for instance 5d1d1e2a-ddc9-4a66-8db4-6cccea722024 on hv-cinder-77957 Aug 24 13:47:17.406878 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-7b6dbb82-a8f9-4a87-94eb-b991592febfa req-bd39987d-54f3-443c-95fc-ae990c006998 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034368 Aug 24 13:47:17.407482 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 472/957] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:47:18.016464 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-57b60a10-f0bc-4bbe-844b-35e05226836b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:18.017089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-57b60a10-f0bc-4bbe-844b-35e05226836b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:18.024734 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-57b60a10-f0bc-4bbe-844b-35e05226836b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:18.025325 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-57b60a10-f0bc-4bbe-844b-35e05226836b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:18.025790 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-57b60a10-f0bc-4bbe-844b-35e05226836b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:18.026473 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-57b60a10-f0bc-4bbe-844b-35e05226836b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:18.026923 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-57b60a10-f0bc-4bbe-844b-35e05226836b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:18.027345 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-57b60a10-f0bc-4bbe-844b-35e05226836b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:18.181047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-57b60a10-f0bc-4bbe-844b-35e05226836b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:18.188974 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-57b60a10-f0bc-4bbe-844b-35e05226836b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1359 microversion: 2.1 time: 0.176499 Aug 24 13:47:18.189596 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 486/958] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:18 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:19.213622 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-d94b439e-78c6-4bc7-8997-42cf3374c57f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:19.214252 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-d94b439e-78c6-4bc7-8997-42cf3374c57f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:19.222277 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d94b439e-78c6-4bc7-8997-42cf3374c57f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:19.222778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d94b439e-78c6-4bc7-8997-42cf3374c57f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:19.223790 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d94b439e-78c6-4bc7-8997-42cf3374c57f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:19.224530 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d94b439e-78c6-4bc7-8997-42cf3374c57f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:19.224988 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d94b439e-78c6-4bc7-8997-42cf3374c57f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:19.225417 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d94b439e-78c6-4bc7-8997-42cf3374c57f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:19.382493 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-d94b439e-78c6-4bc7-8997-42cf3374c57f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:19.394147 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-d94b439e-78c6-4bc7-8997-42cf3374c57f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1359 microversion: 2.1 time: 0.186814 Aug 24 13:47:19.398357 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 473/959] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:19 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:20.416525 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-cbf1cf24-3bc9-4276-a7c5-e37db45cb7f1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:20.417149 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-cbf1cf24-3bc9-4276-a7c5-e37db45cb7f1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:20.423670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cbf1cf24-3bc9-4276-a7c5-e37db45cb7f1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:20.424161 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cbf1cf24-3bc9-4276-a7c5-e37db45cb7f1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:20.424634 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cbf1cf24-3bc9-4276-a7c5-e37db45cb7f1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:20.425342 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cbf1cf24-3bc9-4276-a7c5-e37db45cb7f1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:20.425827 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cbf1cf24-3bc9-4276-a7c5-e37db45cb7f1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:20.426944 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cbf1cf24-3bc9-4276-a7c5-e37db45cb7f1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:20.568850 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-cbf1cf24-3bc9-4276-a7c5-e37db45cb7f1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:20.576828 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-cbf1cf24-3bc9-4276-a7c5-e37db45cb7f1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1550 microversion: 2.1 time: 0.164181 Aug 24 13:47:20.577414 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 487/960] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:20 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1550 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:20.596979 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-8603aa74-90af-4a8b-b6d3-c2d2dd6534a2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:20.597539 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-8603aa74-90af-4a8b-b6d3-c2d2dd6534a2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:20.605347 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8603aa74-90af-4a8b-b6d3-c2d2dd6534a2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:20.615694 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8603aa74-90af-4a8b-b6d3-c2d2dd6534a2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:20.616167 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8603aa74-90af-4a8b-b6d3-c2d2dd6534a2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:20.616955 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8603aa74-90af-4a8b-b6d3-c2d2dd6534a2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:20.617431 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8603aa74-90af-4a8b-b6d3-c2d2dd6534a2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:20.617864 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8603aa74-90af-4a8b-b6d3-c2d2dd6534a2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:20.756944 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-8603aa74-90af-4a8b-b6d3-c2d2dd6534a2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:20.765268 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-8603aa74-90af-4a8b-b6d3-c2d2dd6534a2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1550 microversion: 2.1 time: 0.172107 Aug 24 13:47:20.765931 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 474/961] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:20 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1550 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:20.786640 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-be1946ba-37c3-45c1-8ba5-81b7fb9ff343 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:20.791584 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-be1946ba-37c3-45c1-8ba5-81b7fb9ff343 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:20.793760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-be1946ba-37c3-45c1-8ba5-81b7fb9ff343 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Searching by: {'deleted': False, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb'} {{(pid=133015) get_all /opt/stack/nova/nova/compute/api.py:3015}} Aug 24 13:47:20.802555 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-be1946ba-37c3-45c1-8ba5-81b7fb9ff343 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:20.803034 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-be1946ba-37c3-45c1-8ba5-81b7fb9ff343 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:20.803513 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-be1946ba-37c3-45c1-8ba5-81b7fb9ff343 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:20.804266 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-be1946ba-37c3-45c1-8ba5-81b7fb9ff343 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:20.804710 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-be1946ba-37c3-45c1-8ba5-81b7fb9ff343 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:20.805126 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-be1946ba-37c3-45c1-8ba5-81b7fb9ff343 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:20.912629 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.multi_cell_list [None req-be1946ba-37c3-45c1-8ba5-81b7fb9ff343 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=133015) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 13:47:21.018073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-be1946ba-37c3-45c1-8ba5-81b7fb9ff343 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.235823 Aug 24 13:47:21.018898 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 488/962] 10.222.0.73 () {58 vars in 1125 bytes} [Wed Aug 24 13:47:20 2022] GET /compute/v2.1/servers => generated 343 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:47:21.037323 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-7c76cca6-df19-4fa7-a589-13d80ced190f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:21.037976 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-7c76cca6-df19-4fa7-a589-13d80ced190f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:21.043993 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7c76cca6-df19-4fa7-a589-13d80ced190f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:21.044553 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7c76cca6-df19-4fa7-a589-13d80ced190f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:21.044998 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7c76cca6-df19-4fa7-a589-13d80ced190f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:21.045694 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7c76cca6-df19-4fa7-a589-13d80ced190f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:21.046155 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7c76cca6-df19-4fa7-a589-13d80ced190f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:21.046587 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7c76cca6-df19-4fa7-a589-13d80ced190f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:21.184348 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-7c76cca6-df19-4fa7-a589-13d80ced190f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:21.193295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-7c76cca6-df19-4fa7-a589-13d80ced190f tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1550 microversion: 2.1 time: 0.161058 Aug 24 13:47:21.193834 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 475/963] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:21 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1550 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:21.743427 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a29a5284-e02c-4fac-8902-7c28a1f78628 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41d197d3-5842-4a91-b533-b9984cf4984e"}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:47:21.745901 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-a29a5284-e02c-4fac-8902-7c28a1f78628 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:21.754233 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a29a5284-e02c-4fac-8902-7c28a1f78628 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:21.754233 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a29a5284-e02c-4fac-8902-7c28a1f78628 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:21.756922 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a29a5284-e02c-4fac-8902-7c28a1f78628 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:21.756922 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a29a5284-e02c-4fac-8902-7c28a1f78628 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:21.756922 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a29a5284-e02c-4fac-8902-7c28a1f78628 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:21.756922 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a29a5284-e02c-4fac-8902-7c28a1f78628 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:21.779227 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=100 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:47:22.878888 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a29a5284-e02c-4fac-8902-7c28a1f78628 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "POST /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.139568 Aug 24 13:47:22.879998 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 489/964] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 13:47:21 2022] POST /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a/os-volume_attachments => generated 194 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:47:24.354899 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-11f659f7-6fb6-49e8-87d4-59c5d1ee1a3c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4557bf98-ba90-429e-92fb-02fbc229b672"}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:47:24.357335 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-11f659f7-6fb6-49e8-87d4-59c5d1ee1a3c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:24.365338 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-11f659f7-6fb6-49e8-87d4-59c5d1ee1a3c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:24.365751 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-11f659f7-6fb6-49e8-87d4-59c5d1ee1a3c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:24.366184 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-11f659f7-6fb6-49e8-87d4-59c5d1ee1a3c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:24.366901 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-11f659f7-6fb6-49e8-87d4-59c5d1ee1a3c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:24.367336 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-11f659f7-6fb6-49e8-87d4-59c5d1ee1a3c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:24.367824 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-11f659f7-6fb6-49e8-87d4-59c5d1ee1a3c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:24.388400 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:47:25.164398 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-11f659f7-6fb6-49e8-87d4-59c5d1ee1a3c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "POST /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.813214 Aug 24 13:47:25.168368 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 476/965] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 13:47:24 2022] POST /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024/os-volume_attachments => generated 194 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:47:31.607335 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=2 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:47:31.610273 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-6301b554-1c98-4739-9bbc-01fe5616ed8d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:47:31.620857 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:47:31.620857 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6301b554-1c98-4739-9bbc-01fe5616ed8d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:31.620857 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6301b554-1c98-4739-9bbc-01fe5616ed8d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:31.620857 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6301b554-1c98-4739-9bbc-01fe5616ed8d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:31.680421 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-6301b554-1c98-4739-9bbc-01fe5616ed8d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Going to try to stop instance {{(pid=133015) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 13:47:32.071353 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-6301b554-1c98-4739-9bbc-01fe5616ed8d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "POST /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a/action" status: 202 len: 0 microversion: 2.1 time: 0.466596 Aug 24 13:47:32.071983 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 490/966] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 13:47:31 2022] POST /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:47:32.082122 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-456b4439-be5f-45aa-8f50-035a94c2419e tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:32.082981 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-456b4439-be5f-45aa-8f50-035a94c2419e tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:32.087599 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:47:32.092972 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-456b4439-be5f-45aa-8f50-035a94c2419e tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:32.093473 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-456b4439-be5f-45aa-8f50-035a94c2419e tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:32.093931 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-456b4439-be5f-45aa-8f50-035a94c2419e tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:32.094621 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-456b4439-be5f-45aa-8f50-035a94c2419e tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:32.095113 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-456b4439-be5f-45aa-8f50-035a94c2419e tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:32.095543 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-456b4439-be5f-45aa-8f50-035a94c2419e tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:32.239295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-456b4439-be5f-45aa-8f50-035a94c2419e tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:32.247710 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-456b4439-be5f-45aa-8f50-035a94c2419e tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1721 microversion: 2.1 time: 0.170815 Aug 24 13:47:32.248331 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 477/967] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:32 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:33.270035 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-ee041c6c-5d5c-4efe-8c30-7d641484344d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:33.270763 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-ee041c6c-5d5c-4efe-8c30-7d641484344d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:33.277869 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ee041c6c-5d5c-4efe-8c30-7d641484344d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:33.278358 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ee041c6c-5d5c-4efe-8c30-7d641484344d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:33.278797 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ee041c6c-5d5c-4efe-8c30-7d641484344d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:33.279698 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ee041c6c-5d5c-4efe-8c30-7d641484344d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:33.280155 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ee041c6c-5d5c-4efe-8c30-7d641484344d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:33.280604 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ee041c6c-5d5c-4efe-8c30-7d641484344d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:33.680001 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-ee041c6c-5d5c-4efe-8c30-7d641484344d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:33.688709 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-ee041c6c-5d5c-4efe-8c30-7d641484344d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1721 microversion: 2.1 time: 0.423421 Aug 24 13:47:33.689301 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 491/968] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:33 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1721 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:34.711532 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-14bbba9d-64df-42f9-a893-5e4160ffa816 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:34.712149 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-14bbba9d-64df-42f9-a893-5e4160ffa816 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:34.719107 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-14bbba9d-64df-42f9-a893-5e4160ffa816 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:34.719588 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-14bbba9d-64df-42f9-a893-5e4160ffa816 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:34.721066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-14bbba9d-64df-42f9-a893-5e4160ffa816 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:34.721066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-14bbba9d-64df-42f9-a893-5e4160ffa816 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:34.721313 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-14bbba9d-64df-42f9-a893-5e4160ffa816 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:34.721620 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-14bbba9d-64df-42f9-a893-5e4160ffa816 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:34.863939 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-14bbba9d-64df-42f9-a893-5e4160ffa816 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:34.873858 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-14bbba9d-64df-42f9-a893-5e4160ffa816 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1721 microversion: 2.1 time: 0.167254 Aug 24 13:47:34.874568 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 478/969] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:34 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:35.900867 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-084d7e09-456e-4833-8d29-b31655eff1e2 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:35.901557 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-084d7e09-456e-4833-8d29-b31655eff1e2 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:35.908075 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-084d7e09-456e-4833-8d29-b31655eff1e2 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:35.908580 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-084d7e09-456e-4833-8d29-b31655eff1e2 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:35.909012 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-084d7e09-456e-4833-8d29-b31655eff1e2 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:35.909688 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-084d7e09-456e-4833-8d29-b31655eff1e2 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:35.910130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-084d7e09-456e-4833-8d29-b31655eff1e2 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:35.910595 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-084d7e09-456e-4833-8d29-b31655eff1e2 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:36.068700 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-084d7e09-456e-4833-8d29-b31655eff1e2 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:36.076923 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-084d7e09-456e-4833-8d29-b31655eff1e2 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1721 microversion: 2.1 time: 0.180125 Aug 24 13:47:36.077491 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 492/970] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:35 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:36.103862 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-437e6612-d78d-4406-90fa-19c859346074 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1704059648", "imageRef": "c520113c-3dae-4490-98bb-19fe3a46b66d", "flavorRef": "452", "networks": [{"uuid": "aba50ab5-0afd-4b22-a05b-b99018130d42"}]}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:47:36.155883 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.network.neutron [None req-437e6612-d78d-4406-90fa-19c859346074 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] validate_networks() for [('aba50ab5-0afd-4b22-a05b-b99018130d42', None, None, None, None, None)] {{(pid=133014) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:47:36.530626 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-437e6612-d78d-4406-90fa-19c859346074 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Flavor limits 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:47:36.531401 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-437e6612-d78d-4406-90fa-19c859346074 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Image limits 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:47:36.532343 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-437e6612-d78d-4406-90fa-19c859346074 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Flavor pref 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:47:36.533118 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-437e6612-d78d-4406-90fa-19c859346074 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Image pref 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:47:36.533952 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-437e6612-d78d-4406-90fa-19c859346074 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:47:36.546278 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-437e6612-d78d-4406-90fa-19c859346074 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:36.547163 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-437e6612-d78d-4406-90fa-19c859346074 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:36.547908 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-437e6612-d78d-4406-90fa-19c859346074 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:36.548925 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-437e6612-d78d-4406-90fa-19c859346074 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:36.549755 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-437e6612-d78d-4406-90fa-19c859346074 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:36.550532 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-437e6612-d78d-4406-90fa-19c859346074 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:36.569846 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-437e6612-d78d-4406-90fa-19c859346074 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Getting quotas for project 1a7c5f7e89a74cab86be21c2bb4819ab. Resources: {'instances', 'cores', 'ram'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:47:36.573901 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-437e6612-d78d-4406-90fa-19c859346074 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Getting quotas for user e9ee68b458234fe482b5c2e777b71967 and project 1a7c5f7e89a74cab86be21c2bb4819ab. Resources: {'instances', 'cores', 'ram'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:47:36.585530 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-437e6612-d78d-4406-90fa-19c859346074 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Going to run 1 instances... {{(pid=133014) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 13:47:36.590693 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-437e6612-d78d-4406-90fa-19c859346074 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 6ebc061f-f94f-491b-ab41-a3182c046c61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c520113c-3dae-4490-98bb-19fe3a46b66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133014) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 13:47:36.754606 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-437e6612-d78d-4406-90fa-19c859346074 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657829 Aug 24 13:47:36.755242 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 479/971] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 13:47:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 13:47:36.765913 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d39a31fe-0f87-4301-9616-e7817aaf5de1 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:36.766525 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-d39a31fe-0f87-4301-9616-e7817aaf5de1 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 6ebc061f-f94f-491b-ab41-a3182c046c61] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:36.820629 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d39a31fe-0f87-4301-9616-e7817aaf5de1 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:36.828472 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-d39a31fe-0f87-4301-9616-e7817aaf5de1 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61" status: 200 len: 1219 microversion: 2.1 time: 0.066257 Aug 24 13:47:36.829052 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 493/972] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:36 2022] GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:37.100572 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-94e2cfef-2d3e-4164-98fd-d670cd17f5a4 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:37.101247 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-94e2cfef-2d3e-4164-98fd-d670cd17f5a4 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:37.107374 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-94e2cfef-2d3e-4164-98fd-d670cd17f5a4 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:37.107955 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-94e2cfef-2d3e-4164-98fd-d670cd17f5a4 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:37.108299 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-94e2cfef-2d3e-4164-98fd-d670cd17f5a4 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:37.108982 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-94e2cfef-2d3e-4164-98fd-d670cd17f5a4 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:37.109431 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-94e2cfef-2d3e-4164-98fd-d670cd17f5a4 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:37.109847 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-94e2cfef-2d3e-4164-98fd-d670cd17f5a4 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:37.247423 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-94e2cfef-2d3e-4164-98fd-d670cd17f5a4 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:37.259184 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-94e2cfef-2d3e-4164-98fd-d670cd17f5a4 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1721 microversion: 2.1 time: 0.162695 Aug 24 13:47:37.259703 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 480/973] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:37 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:37.849076 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-3accff57-4983-4355-8023-acd2c36b8b9b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:37.849713 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-3accff57-4983-4355-8023-acd2c36b8b9b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 6ebc061f-f94f-491b-ab41-a3182c046c61] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:37.908876 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-3accff57-4983-4355-8023-acd2c36b8b9b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:37.916245 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-3accff57-4983-4355-8023-acd2c36b8b9b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61" status: 200 len: 1219 microversion: 2.1 time: 0.071052 Aug 24 13:47:37.920862 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 494/974] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:37 2022] GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:38.284580 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-3a888857-d1cb-4018-91c9-a857daa3c136 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:38.285202 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-3a888857-d1cb-4018-91c9-a857daa3c136 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:38.293111 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3a888857-d1cb-4018-91c9-a857daa3c136 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:38.293604 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3a888857-d1cb-4018-91c9-a857daa3c136 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:38.294046 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3a888857-d1cb-4018-91c9-a857daa3c136 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:38.294748 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3a888857-d1cb-4018-91c9-a857daa3c136 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:38.295215 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3a888857-d1cb-4018-91c9-a857daa3c136 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:38.295699 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3a888857-d1cb-4018-91c9-a857daa3c136 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:38.439353 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3a888857-d1cb-4018-91c9-a857daa3c136 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:38.448918 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-3a888857-d1cb-4018-91c9-a857daa3c136 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1721 microversion: 2.1 time: 0.168139 Aug 24 13:47:38.449501 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 481/975] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:38 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:38.937232 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-be4808c8-969f-4f7a-94a1-f8e7a5d34f66 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:38.937851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-be4808c8-969f-4f7a-94a1-f8e7a5d34f66 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 6ebc061f-f94f-491b-ab41-a3182c046c61] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:38.945452 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-be4808c8-969f-4f7a-94a1-f8e7a5d34f66 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:38.945936 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-be4808c8-969f-4f7a-94a1-f8e7a5d34f66 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:38.946366 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-be4808c8-969f-4f7a-94a1-f8e7a5d34f66 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:38.947058 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-be4808c8-969f-4f7a-94a1-f8e7a5d34f66 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:38.947509 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-be4808c8-969f-4f7a-94a1-f8e7a5d34f66 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:38.947928 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-be4808c8-969f-4f7a-94a1-f8e7a5d34f66 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:39.009987 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-be4808c8-969f-4f7a-94a1-f8e7a5d34f66 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:39.017615 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-be4808c8-969f-4f7a-94a1-f8e7a5d34f66 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61" status: 200 len: 1223 microversion: 2.1 time: 0.084218 Aug 24 13:47:39.018389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 495/976] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:38 2022] GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:39.471884 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-7ebcfc01-bcda-463e-80f2-bcec22b73d6c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:39.472824 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-7ebcfc01-bcda-463e-80f2-bcec22b73d6c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:39.480679 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7ebcfc01-bcda-463e-80f2-bcec22b73d6c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:39.481169 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7ebcfc01-bcda-463e-80f2-bcec22b73d6c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:39.481607 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7ebcfc01-bcda-463e-80f2-bcec22b73d6c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:39.482335 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7ebcfc01-bcda-463e-80f2-bcec22b73d6c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:39.482791 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7ebcfc01-bcda-463e-80f2-bcec22b73d6c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:39.483209 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-7ebcfc01-bcda-463e-80f2-bcec22b73d6c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:39.628783 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-7ebcfc01-bcda-463e-80f2-bcec22b73d6c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:39.637491 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-7ebcfc01-bcda-463e-80f2-bcec22b73d6c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1721 microversion: 2.1 time: 0.170304 Aug 24 13:47:39.638064 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 482/977] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:39 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:40.039609 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-33c4ffdd-8b43-4abb-af22-325db941146b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:40.040287 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-33c4ffdd-8b43-4abb-af22-325db941146b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 6ebc061f-f94f-491b-ab41-a3182c046c61] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:40.046926 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-33c4ffdd-8b43-4abb-af22-325db941146b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:40.047515 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-33c4ffdd-8b43-4abb-af22-325db941146b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:40.047963 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-33c4ffdd-8b43-4abb-af22-325db941146b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:40.048701 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-33c4ffdd-8b43-4abb-af22-325db941146b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:40.049161 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-33c4ffdd-8b43-4abb-af22-325db941146b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:40.049586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-33c4ffdd-8b43-4abb-af22-325db941146b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:40.115625 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-33c4ffdd-8b43-4abb-af22-325db941146b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:40.124378 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-33c4ffdd-8b43-4abb-af22-325db941146b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61" status: 200 len: 1223 microversion: 2.1 time: 0.088683 Aug 24 13:47:40.124986 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 496/978] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:40 2022] GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:40.661649 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-bddd069d-5e20-4f90-87cf-d806ffd7ea69 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:40.662267 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-bddd069d-5e20-4f90-87cf-d806ffd7ea69 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:40.669254 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bddd069d-5e20-4f90-87cf-d806ffd7ea69 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:40.674470 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bddd069d-5e20-4f90-87cf-d806ffd7ea69 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:40.674470 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bddd069d-5e20-4f90-87cf-d806ffd7ea69 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:40.674470 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bddd069d-5e20-4f90-87cf-d806ffd7ea69 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:40.674470 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bddd069d-5e20-4f90-87cf-d806ffd7ea69 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:40.674950 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bddd069d-5e20-4f90-87cf-d806ffd7ea69 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:40.811903 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-bddd069d-5e20-4f90-87cf-d806ffd7ea69 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:40.821555 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-bddd069d-5e20-4f90-87cf-d806ffd7ea69 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1721 microversion: 2.1 time: 0.163882 Aug 24 13:47:40.822152 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 483/979] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:40 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:41.144807 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-4c648a8a-dc0e-4586-b8ce-e1c7ff76d4af tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:41.145433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-4c648a8a-dc0e-4586-b8ce-e1c7ff76d4af tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 6ebc061f-f94f-491b-ab41-a3182c046c61] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:41.152396 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4c648a8a-dc0e-4586-b8ce-e1c7ff76d4af tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:41.152889 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4c648a8a-dc0e-4586-b8ce-e1c7ff76d4af tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:41.153332 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4c648a8a-dc0e-4586-b8ce-e1c7ff76d4af tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:41.154036 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4c648a8a-dc0e-4586-b8ce-e1c7ff76d4af tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:41.154489 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4c648a8a-dc0e-4586-b8ce-e1c7ff76d4af tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:41.154919 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4c648a8a-dc0e-4586-b8ce-e1c7ff76d4af tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:41.229662 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4c648a8a-dc0e-4586-b8ce-e1c7ff76d4af tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:41.237653 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-4c648a8a-dc0e-4586-b8ce-e1c7ff76d4af tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61" status: 200 len: 1271 microversion: 2.1 time: 0.096495 Aug 24 13:47:41.238151 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 497/980] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:41 2022] GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61 => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:41.320634 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-6c770cc1-8ef8-4bbd-82e9-1253e8b87d90 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:41.323912 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-6c770cc1-8ef8-4bbd-82e9-1253e8b87d90 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:41.335990 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6c770cc1-8ef8-4bbd-82e9-1253e8b87d90 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:41.336526 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6c770cc1-8ef8-4bbd-82e9-1253e8b87d90 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:41.336967 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6c770cc1-8ef8-4bbd-82e9-1253e8b87d90 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:41.337734 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6c770cc1-8ef8-4bbd-82e9-1253e8b87d90 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:41.338127 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6c770cc1-8ef8-4bbd-82e9-1253e8b87d90 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:41.338555 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6c770cc1-8ef8-4bbd-82e9-1253e8b87d90 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:41.562469 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-6c770cc1-8ef8-4bbd-82e9-1253e8b87d90 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:41.571873 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-6c770cc1-8ef8-4bbd-82e9-1253e8b87d90 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1596 microversion: 2.1 time: 0.256790 Aug 24 13:47:41.572781 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 484/981] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:41 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1596 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:41.843128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-9e435abd-24aa-4fb6-a4a2-a9e3dd87e68f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:41.843896 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-9e435abd-24aa-4fb6-a4a2-a9e3dd87e68f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:41.850042 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9e435abd-24aa-4fb6-a4a2-a9e3dd87e68f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:41.851379 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9e435abd-24aa-4fb6-a4a2-a9e3dd87e68f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:41.854966 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9e435abd-24aa-4fb6-a4a2-a9e3dd87e68f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:41.855781 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9e435abd-24aa-4fb6-a4a2-a9e3dd87e68f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:41.856367 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9e435abd-24aa-4fb6-a4a2-a9e3dd87e68f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:41.856799 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9e435abd-24aa-4fb6-a4a2-a9e3dd87e68f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:42.149853 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-9e435abd-24aa-4fb6-a4a2-a9e3dd87e68f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:42.159506 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-9e435abd-24aa-4fb6-a4a2-a9e3dd87e68f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1721 microversion: 2.1 time: 0.320324 Aug 24 13:47:42.160104 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 498/982] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:41 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1721 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:42.262219 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-965975b3-c1e6-4567-929d-947af67c2be8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:42.263464 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-965975b3-c1e6-4567-929d-947af67c2be8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 6ebc061f-f94f-491b-ab41-a3182c046c61] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:42.274297 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-965975b3-c1e6-4567-929d-947af67c2be8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:42.274989 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-965975b3-c1e6-4567-929d-947af67c2be8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:42.275789 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-965975b3-c1e6-4567-929d-947af67c2be8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:42.277112 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-965975b3-c1e6-4567-929d-947af67c2be8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:42.277965 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-965975b3-c1e6-4567-929d-947af67c2be8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:42.278677 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-965975b3-c1e6-4567-929d-947af67c2be8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:42.376586 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-965975b3-c1e6-4567-929d-947af67c2be8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:42.385799 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-965975b3-c1e6-4567-929d-947af67c2be8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61" status: 200 len: 1277 microversion: 2.1 time: 0.129203 Aug 24 13:47:42.386392 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 485/983] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:42 2022] GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61 => generated 1277 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:43.184283 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-861601d8-a9de-4159-bd33-1f45bb24155f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:43.185485 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-861601d8-a9de-4159-bd33-1f45bb24155f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:43.192691 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-861601d8-a9de-4159-bd33-1f45bb24155f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:43.198048 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-861601d8-a9de-4159-bd33-1f45bb24155f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:43.198048 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-861601d8-a9de-4159-bd33-1f45bb24155f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:43.198048 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-861601d8-a9de-4159-bd33-1f45bb24155f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:43.198048 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-861601d8-a9de-4159-bd33-1f45bb24155f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:43.198437 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-861601d8-a9de-4159-bd33-1f45bb24155f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:43.408036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-62ddad8f-0077-4ed8-a85b-d245772c5f87 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:43.408679 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-62ddad8f-0077-4ed8-a85b-d245772c5f87 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 6ebc061f-f94f-491b-ab41-a3182c046c61] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:43.414975 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-62ddad8f-0077-4ed8-a85b-d245772c5f87 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:43.415462 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-62ddad8f-0077-4ed8-a85b-d245772c5f87 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:43.415901 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-62ddad8f-0077-4ed8-a85b-d245772c5f87 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:43.416633 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-62ddad8f-0077-4ed8-a85b-d245772c5f87 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:43.417102 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-62ddad8f-0077-4ed8-a85b-d245772c5f87 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:43.417505 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-62ddad8f-0077-4ed8-a85b-d245772c5f87 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:43.777386 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-861601d8-a9de-4159-bd33-1f45bb24155f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:43.785885 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-861601d8-a9de-4159-bd33-1f45bb24155f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1721 microversion: 2.1 time: 0.606207 Aug 24 13:47:43.786564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 499/984] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:43 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1721 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:43.852640 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-62ddad8f-0077-4ed8-a85b-d245772c5f87 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:43.860611 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-62ddad8f-0077-4ed8-a85b-d245772c5f87 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61" status: 200 len: 1319 microversion: 2.1 time: 0.456526 Aug 24 13:47:43.863020 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 486/985] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:43 2022] GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61 => generated 1319 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:47:44.371275 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-3399ffc8-730a-4b73-9ab3-a31bc66043ae req-3752c787-d2b9-4ed3-8033-919c849d94a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ebc061f-f94f-491b-ab41-a3182c046c61", "tag": "e8bc6f55-990a-4e53-96e4-3a5c045be05c"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:47:44.387336 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-3399ffc8-730a-4b73-9ab3-a31bc66043ae req-3752c787-d2b9-4ed3-8033-919c849d94a6 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:44.387877 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-3399ffc8-730a-4b73-9ab3-a31bc66043ae req-3752c787-d2b9-4ed3-8033-919c849d94a6 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:44.388956 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-3399ffc8-730a-4b73-9ab3-a31bc66043ae req-3752c787-d2b9-4ed3-8033-919c849d94a6 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:44.397583 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-92a40565-3239-491d-a4f2-d6d6a4bebd29 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1528802645", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-797259511", "security_groups": [{"name": "tempest-secgroup-smoke-856119561"}], "block_device_mapping_v2": [{"uuid": "e7f9562d-925c-4924-bb64-f71da1b111e4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "440bd507-b6ac-4736-a4d2-ede05189225c"}]}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:47:44.402670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-3399ffc8-730a-4b73-9ab3-a31bc66043ae req-3752c787-d2b9-4ed3-8033-919c849d94a6 service nova] Creating event network-changed:e8bc6f55-990a-4e53-96e4-3a5c045be05c for instance 6ebc061f-f94f-491b-ab41-a3182c046c61 on hv-cinder-77957 Aug 24 13:47:44.416345 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-3399ffc8-730a-4b73-9ab3-a31bc66043ae req-3752c787-d2b9-4ed3-8033-919c849d94a6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043283 Aug 24 13:47:44.417236 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 500/986] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:47:44.663127 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.network.neutron [None req-92a40565-3239-491d-a4f2-d6d6a4bebd29 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] validate_networks() for [('440bd507-b6ac-4736-a4d2-ede05189225c', None, None, None, None, None)] {{(pid=133014) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:47:44.811738 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a78c9ded-68de-47ad-93d3-072b3c4d0302 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:44.812715 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-a78c9ded-68de-47ad-93d3-072b3c4d0302 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:44.819416 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a78c9ded-68de-47ad-93d3-072b3c4d0302 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:44.820081 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a78c9ded-68de-47ad-93d3-072b3c4d0302 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:44.820623 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a78c9ded-68de-47ad-93d3-072b3c4d0302 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:44.821409 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a78c9ded-68de-47ad-93d3-072b3c4d0302 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:44.821976 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a78c9ded-68de-47ad-93d3-072b3c4d0302 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:44.822406 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a78c9ded-68de-47ad-93d3-072b3c4d0302 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:45.255778 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-a78c9ded-68de-47ad-93d3-072b3c4d0302 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:45.266053 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a78c9ded-68de-47ad-93d3-072b3c4d0302 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1721 microversion: 2.1 time: 0.458717 Aug 24 13:47:45.266840 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 501/987] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:44 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1721 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:47:45.283005 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-03fa8eba-717b-42ad-8582-904ce42c0de8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:45.283681 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-03fa8eba-717b-42ad-8582-904ce42c0de8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 6ebc061f-f94f-491b-ab41-a3182c046c61] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:45.290711 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-03fa8eba-717b-42ad-8582-904ce42c0de8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:45.291261 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-03fa8eba-717b-42ad-8582-904ce42c0de8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:45.291648 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-03fa8eba-717b-42ad-8582-904ce42c0de8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:45.292544 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-03fa8eba-717b-42ad-8582-904ce42c0de8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:45.293073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-03fa8eba-717b-42ad-8582-904ce42c0de8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:45.293435 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-03fa8eba-717b-42ad-8582-904ce42c0de8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:45.721711 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-03fa8eba-717b-42ad-8582-904ce42c0de8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:45.731795 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-03fa8eba-717b-42ad-8582-904ce42c0de8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61" status: 200 len: 1319 microversion: 2.1 time: 0.463635 Aug 24 13:47:45.732598 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 502/988] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:45 2022] GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61 => generated 1319 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:45.820234 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-92a40565-3239-491d-a4f2-d6d6a4bebd29 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Flavor limits 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:47:45.820916 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-92a40565-3239-491d-a4f2-d6d6a4bebd29 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Image limits 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:47:45.821113 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-92a40565-3239-491d-a4f2-d6d6a4bebd29 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Flavor pref 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:47:45.821789 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-92a40565-3239-491d-a4f2-d6d6a4bebd29 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Image pref 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:47:45.822201 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-92a40565-3239-491d-a4f2-d6d6a4bebd29 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:47:45.833990 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-92a40565-3239-491d-a4f2-d6d6a4bebd29 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:45.835351 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-92a40565-3239-491d-a4f2-d6d6a4bebd29 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:45.835972 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-92a40565-3239-491d-a4f2-d6d6a4bebd29 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:45.836918 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-92a40565-3239-491d-a4f2-d6d6a4bebd29 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:45.837555 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-92a40565-3239-491d-a4f2-d6d6a4bebd29 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:45.838148 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-92a40565-3239-491d-a4f2-d6d6a4bebd29 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:45.857481 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-92a40565-3239-491d-a4f2-d6d6a4bebd29 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Getting quotas for project 6842f55d3dcc42289b6bfe02ed020dc4. Resources: {'instances', 'cores', 'ram'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:47:45.861808 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-92a40565-3239-491d-a4f2-d6d6a4bebd29 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Getting quotas for user 98b30f0436864263b2829921f212f8ce and project 6842f55d3dcc42289b6bfe02ed020dc4. Resources: {'instances', 'cores', 'ram'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:47:45.929545 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-92a40565-3239-491d-a4f2-d6d6a4bebd29 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Going to run 1 instances... {{(pid=133014) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 13:47:45.929545 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-92a40565-3239-491d-a4f2-d6d6a4bebd29 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e7f9562d-925c-4924-bb64-f71da1b111e4',volume_size=None,volume_type=None)] {{(pid=133014) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 13:47:46.291551 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d9807cca-81e3-43d3-8f76-5d09b6b129bb tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:46.292171 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-d9807cca-81e3-43d3-8f76-5d09b6b129bb tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:46.302805 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d9807cca-81e3-43d3-8f76-5d09b6b129bb tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:46.302805 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d9807cca-81e3-43d3-8f76-5d09b6b129bb tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:46.302805 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d9807cca-81e3-43d3-8f76-5d09b6b129bb tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:46.302805 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d9807cca-81e3-43d3-8f76-5d09b6b129bb tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:46.303408 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d9807cca-81e3-43d3-8f76-5d09b6b129bb tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:46.303408 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d9807cca-81e3-43d3-8f76-5d09b6b129bb tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:46.361145 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-92a40565-3239-491d-a4f2-d6d6a4bebd29 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.968717 Aug 24 13:47:46.361804 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 487/989] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 13:47:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 1970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 13:47:46.373338 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-19e98d95-4eec-4612-99cd-0dce8b0b240b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:46.374071 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-19e98d95-4eec-4612-99cd-0dce8b0b240b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:46.473904 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-19e98d95-4eec-4612-99cd-0dce8b0b240b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:46.492771 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-19e98d95-4eec-4612-99cd-0dce8b0b240b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41" status: 200 len: 1094 microversion: 2.1 time: 0.123498 Aug 24 13:47:46.495503 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 488/990] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:46 2022] GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 => generated 1094 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:47:46.510931 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-b664d7ee-3abf-43ab-bcaa-bae97c81818c req-7538f28c-69d2-4299-ae08-71b2c2201c6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d1d1e2a-ddc9-4a66-8db4-6cccea722024", "tag": "918b2634-4141-429d-95ff-f9bae50b39dc"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:47:46.526374 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-b664d7ee-3abf-43ab-bcaa-bae97c81818c req-7538f28c-69d2-4299-ae08-71b2c2201c6e service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:46.528844 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-b664d7ee-3abf-43ab-bcaa-bae97c81818c req-7538f28c-69d2-4299-ae08-71b2c2201c6e service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:46.529346 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-b664d7ee-3abf-43ab-bcaa-bae97c81818c req-7538f28c-69d2-4299-ae08-71b2c2201c6e service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:46.546419 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-b664d7ee-3abf-43ab-bcaa-bae97c81818c req-7538f28c-69d2-4299-ae08-71b2c2201c6e service nova] Creating event network-changed:918b2634-4141-429d-95ff-f9bae50b39dc for instance 5d1d1e2a-ddc9-4a66-8db4-6cccea722024 on hv-cinder-77957 Aug 24 13:47:46.548449 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d9807cca-81e3-43d3-8f76-5d09b6b129bb tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:46.550413 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-b664d7ee-3abf-43ab-bcaa-bae97c81818c req-7538f28c-69d2-4299-ae08-71b2c2201c6e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052691 Aug 24 13:47:46.551227 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 489/991] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:47:46.558064 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-d9807cca-81e3-43d3-8f76-5d09b6b129bb tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1721 microversion: 2.1 time: 0.272685 Aug 24 13:47:46.558726 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 503/992] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:46 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1721 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:46.754138 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e7406040-9270-41c6-aefa-aef7759957c4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:46.754847 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-e7406040-9270-41c6-aefa-aef7759957c4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 6ebc061f-f94f-491b-ab41-a3182c046c61] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:46.764450 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e7406040-9270-41c6-aefa-aef7759957c4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:46.764450 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e7406040-9270-41c6-aefa-aef7759957c4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:46.764883 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e7406040-9270-41c6-aefa-aef7759957c4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:46.765606 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e7406040-9270-41c6-aefa-aef7759957c4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:46.766093 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e7406040-9270-41c6-aefa-aef7759957c4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:46.766515 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e7406040-9270-41c6-aefa-aef7759957c4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:46.942498 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e7406040-9270-41c6-aefa-aef7759957c4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:46.950496 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-e7406040-9270-41c6-aefa-aef7759957c4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61" status: 200 len: 1319 microversion: 2.1 time: 0.200860 Aug 24 13:47:46.951061 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 490/993] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:46 2022] GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:47.513483 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-6bbe3870-092c-4861-b666-63a7d498db72 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:47.514096 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-6bbe3870-092c-4861-b666-63a7d498db72 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:47.520355 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6bbe3870-092c-4861-b666-63a7d498db72 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:47.520836 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6bbe3870-092c-4861-b666-63a7d498db72 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:47.521297 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6bbe3870-092c-4861-b666-63a7d498db72 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:47.522824 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6bbe3870-092c-4861-b666-63a7d498db72 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:47.523532 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6bbe3870-092c-4861-b666-63a7d498db72 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:47.523952 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-6bbe3870-092c-4861-b666-63a7d498db72 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:47.581034 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-9d8bc205-e9b3-4c78-bf09-af24c04fe2a6 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:47.582356 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-9d8bc205-e9b3-4c78-bf09-af24c04fe2a6 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:47.589571 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d8bc205-e9b3-4c78-bf09-af24c04fe2a6 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:47.590116 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d8bc205-e9b3-4c78-bf09-af24c04fe2a6 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:47.590547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d8bc205-e9b3-4c78-bf09-af24c04fe2a6 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:47.591275 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d8bc205-e9b3-4c78-bf09-af24c04fe2a6 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:47.592420 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d8bc205-e9b3-4c78-bf09-af24c04fe2a6 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:47.592885 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9d8bc205-e9b3-4c78-bf09-af24c04fe2a6 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:47.657023 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-6bbe3870-092c-4861-b666-63a7d498db72 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:47.665105 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-6bbe3870-092c-4861-b666-63a7d498db72 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41" status: 200 len: 1144 microversion: 2.1 time: 0.155404 Aug 24 13:47:47.668134 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 504/994] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:47 2022] GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 => generated 1144 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:47.857801 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-9d8bc205-e9b3-4c78-bf09-af24c04fe2a6 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:47.862826 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-9d8bc205-e9b3-4c78-bf09-af24c04fe2a6 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1721 microversion: 2.1 time: 0.287765 Aug 24 13:47:47.863414 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 491/995] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:47 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1721 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:47:47.977566 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-1915a75f-ec44-48ae-b163-c581d969b6de tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:47.983968 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-1915a75f-ec44-48ae-b163-c581d969b6de tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 6ebc061f-f94f-491b-ab41-a3182c046c61] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:47.990172 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=4 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:47:47.996031 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1915a75f-ec44-48ae-b163-c581d969b6de tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:47.996031 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1915a75f-ec44-48ae-b163-c581d969b6de tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:47.997066 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1915a75f-ec44-48ae-b163-c581d969b6de tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:47.998363 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1915a75f-ec44-48ae-b163-c581d969b6de tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:47.999206 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1915a75f-ec44-48ae-b163-c581d969b6de tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:47.999950 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1915a75f-ec44-48ae-b163-c581d969b6de tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:48.234633 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-1915a75f-ec44-48ae-b163-c581d969b6de tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:48.242410 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-1915a75f-ec44-48ae-b163-c581d969b6de tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61" status: 200 len: 1319 microversion: 2.1 time: 0.274910 Aug 24 13:47:48.246262 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 505/996] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:47 2022] GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61 => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:48.687622 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-6a91e02f-c45a-4d0a-a008-fddca039ae81 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:48.687622 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-6a91e02f-c45a-4d0a-a008-fddca039ae81 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:48.695661 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6a91e02f-c45a-4d0a-a008-fddca039ae81 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:48.696520 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6a91e02f-c45a-4d0a-a008-fddca039ae81 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:48.696958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6a91e02f-c45a-4d0a-a008-fddca039ae81 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:48.697666 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6a91e02f-c45a-4d0a-a008-fddca039ae81 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:48.698128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6a91e02f-c45a-4d0a-a008-fddca039ae81 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:48.698719 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6a91e02f-c45a-4d0a-a008-fddca039ae81 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:48.797726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-6a91e02f-c45a-4d0a-a008-fddca039ae81 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:48.808254 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-6a91e02f-c45a-4d0a-a008-fddca039ae81 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41" status: 200 len: 1200 microversion: 2.1 time: 0.125467 Aug 24 13:47:48.808955 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 492/997] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:48 2022] GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 => generated 1200 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:47:48.884681 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-af57d445-15f6-4d4c-b836-db7cbe2d3c39 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:48.886205 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-af57d445-15f6-4d4c-b836-db7cbe2d3c39 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:48.893529 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-af57d445-15f6-4d4c-b836-db7cbe2d3c39 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:48.894048 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-af57d445-15f6-4d4c-b836-db7cbe2d3c39 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:48.894477 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-af57d445-15f6-4d4c-b836-db7cbe2d3c39 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:48.895178 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-af57d445-15f6-4d4c-b836-db7cbe2d3c39 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:48.895663 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-af57d445-15f6-4d4c-b836-db7cbe2d3c39 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:48.896310 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-af57d445-15f6-4d4c-b836-db7cbe2d3c39 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:48.916214 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:47:48.930623 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-9fa08877-6582-4012-9c21-9c0c79d38683 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-175118086"}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:47:48.931168 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-9fa08877-6582-4012-9c21-9c0c79d38683 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:48.937394 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9fa08877-6582-4012-9c21-9c0c79d38683 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:48.937892 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9fa08877-6582-4012-9c21-9c0c79d38683 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:48.938273 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9fa08877-6582-4012-9c21-9c0c79d38683 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:48.938969 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9fa08877-6582-4012-9c21-9c0c79d38683 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:48.939605 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9fa08877-6582-4012-9c21-9c0c79d38683 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:48.940210 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9fa08877-6582-4012-9c21-9c0c79d38683 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:49.200888 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-af57d445-15f6-4d4c-b836-db7cbe2d3c39 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:49.211253 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-af57d445-15f6-4d4c-b836-db7cbe2d3c39 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1721 microversion: 2.1 time: 0.329170 Aug 24 13:47:49.213412 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 506/998] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:48 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1721 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:49.219029 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.network.security_group_api [None req-9fa08877-6582-4012-9c21-9c0c79d38683 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Adding security group 484d3c43-095b-4887-b41a-09657dd45981 to port 918b2634-4141-429d-95ff-f9bae50b39dc Aug 24 13:47:49.263868 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-bbf728cd-247c-4966-bfbf-3cccc2d5be98 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:49.265086 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-bbf728cd-247c-4966-bfbf-3cccc2d5be98 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 6ebc061f-f94f-491b-ab41-a3182c046c61] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:49.271204 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bbf728cd-247c-4966-bfbf-3cccc2d5be98 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:49.271692 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bbf728cd-247c-4966-bfbf-3cccc2d5be98 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:49.272493 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bbf728cd-247c-4966-bfbf-3cccc2d5be98 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:49.273412 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bbf728cd-247c-4966-bfbf-3cccc2d5be98 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:49.273849 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bbf728cd-247c-4966-bfbf-3cccc2d5be98 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:49.274584 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bbf728cd-247c-4966-bfbf-3cccc2d5be98 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:49.612715 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-bbf728cd-247c-4966-bfbf-3cccc2d5be98 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:49.621795 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-bbf728cd-247c-4966-bfbf-3cccc2d5be98 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61" status: 200 len: 1319 microversion: 2.1 time: 0.361634 Aug 24 13:47:49.622393 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 507/999] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:49 2022] GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61 => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:47:49.627442 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-311cc62a-6b03-4baf-847d-87e46e52b7de req-23f36d06-761d-45a0-ac68-2677b308b5c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ebc061f-f94f-491b-ab41-a3182c046c61", "name": "network-vif-plugged", "status": "completed", "tag": "e8bc6f55-990a-4e53-96e4-3a5c045be05c"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:47:49.639318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-311cc62a-6b03-4baf-847d-87e46e52b7de req-23f36d06-761d-45a0-ac68-2677b308b5c9 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:49.639886 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-311cc62a-6b03-4baf-847d-87e46e52b7de req-23f36d06-761d-45a0-ac68-2677b308b5c9 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:49.645457 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-311cc62a-6b03-4baf-847d-87e46e52b7de req-23f36d06-761d-45a0-ac68-2677b308b5c9 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:49.653474 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-311cc62a-6b03-4baf-847d-87e46e52b7de req-23f36d06-761d-45a0-ac68-2677b308b5c9 service nova] Creating event network-vif-plugged:e8bc6f55-990a-4e53-96e4-3a5c045be05c for instance 6ebc061f-f94f-491b-ab41-a3182c046c61 on hv-cinder-77957 Aug 24 13:47:49.658710 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-311cc62a-6b03-4baf-847d-87e46e52b7de req-23f36d06-761d-45a0-ac68-2677b308b5c9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035019 Aug 24 13:47:49.666114 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 508/1000] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:47:49.832281 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-e2a4ff18-917b-4856-bd62-faaa1419deb9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:49.834034 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-e2a4ff18-917b-4856-bd62-faaa1419deb9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:49.844964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e2a4ff18-917b-4856-bd62-faaa1419deb9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:49.845457 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e2a4ff18-917b-4856-bd62-faaa1419deb9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:49.846114 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e2a4ff18-917b-4856-bd62-faaa1419deb9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:49.846839 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e2a4ff18-917b-4856-bd62-faaa1419deb9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:49.847317 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e2a4ff18-917b-4856-bd62-faaa1419deb9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:49.847741 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e2a4ff18-917b-4856-bd62-faaa1419deb9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:49.949894 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-e2a4ff18-917b-4856-bd62-faaa1419deb9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:49.963504 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-e2a4ff18-917b-4856-bd62-faaa1419deb9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41" status: 200 len: 1210 microversion: 2.1 time: 0.135411 Aug 24 13:47:49.964389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 509/1001] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:49 2022] GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 => generated 1210 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:47:50.055770 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-9fa08877-6582-4012-9c21-9c0c79d38683 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "POST /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024/action" status: 202 len: 0 microversion: 2.1 time: 1.128692 Aug 24 13:47:50.056978 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 493/1002] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 13:47:48 2022] POST /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024/action => generated 0 bytes in 1131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:47:50.063289 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-9ad7617a-b505-4e0a-9fb5-5613b73ba8c3 req-558810ea-281e-4c00-a95c-e166be6708b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d1d1e2a-ddc9-4a66-8db4-6cccea722024", "tag": "918b2634-4141-429d-95ff-f9bae50b39dc"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:47:50.073174 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-d7f60430-1851-4f0c-9bd6-ae39c39f6927 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:50.073805 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-d7f60430-1851-4f0c-9bd6-ae39c39f6927 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:50.083573 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-9ad7617a-b505-4e0a-9fb5-5613b73ba8c3 req-558810ea-281e-4c00-a95c-e166be6708b5 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:50.084060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-9ad7617a-b505-4e0a-9fb5-5613b73ba8c3 req-558810ea-281e-4c00-a95c-e166be6708b5 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:50.085098 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-9ad7617a-b505-4e0a-9fb5-5613b73ba8c3 req-558810ea-281e-4c00-a95c-e166be6708b5 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:50.091545 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d7f60430-1851-4f0c-9bd6-ae39c39f6927 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:50.091545 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d7f60430-1851-4f0c-9bd6-ae39c39f6927 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:50.091545 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d7f60430-1851-4f0c-9bd6-ae39c39f6927 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:50.091545 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d7f60430-1851-4f0c-9bd6-ae39c39f6927 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:50.091953 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d7f60430-1851-4f0c-9bd6-ae39c39f6927 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:50.091953 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d7f60430-1851-4f0c-9bd6-ae39c39f6927 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:50.120043 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-9ad7617a-b505-4e0a-9fb5-5613b73ba8c3 req-558810ea-281e-4c00-a95c-e166be6708b5 service nova] Creating event network-changed:918b2634-4141-429d-95ff-f9bae50b39dc for instance 5d1d1e2a-ddc9-4a66-8db4-6cccea722024 on hv-cinder-77957 Aug 24 13:47:50.128446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-9ad7617a-b505-4e0a-9fb5-5613b73ba8c3 req-558810ea-281e-4c00-a95c-e166be6708b5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068582 Aug 24 13:47:50.132789 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 510/1003] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:47:50.234952 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-2e24c876-2396-4bf7-833a-4c08b1210efa tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:50.236050 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-2e24c876-2396-4bf7-833a-4c08b1210efa tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:50.243600 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2e24c876-2396-4bf7-833a-4c08b1210efa tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:50.244286 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2e24c876-2396-4bf7-833a-4c08b1210efa tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:50.244917 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2e24c876-2396-4bf7-833a-4c08b1210efa tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:50.246006 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2e24c876-2396-4bf7-833a-4c08b1210efa tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:50.246755 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2e24c876-2396-4bf7-833a-4c08b1210efa tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:50.247416 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2e24c876-2396-4bf7-833a-4c08b1210efa tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:50.426929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-d7f60430-1851-4f0c-9bd6-ae39c39f6927 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:50.449142 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-d7f60430-1851-4f0c-9bd6-ae39c39f6927 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1760 microversion: 2.1 time: 0.377964 Aug 24 13:47:50.451651 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 494/1004] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:50 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1760 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:50.464968 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-2e24c876-2396-4bf7-833a-4c08b1210efa tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:50.480876 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-2e24c876-2396-4bf7-833a-4c08b1210efa tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1721 microversion: 2.1 time: 0.251306 Aug 24 13:47:50.481670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 511/1005] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:50 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:47:50.643321 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-f3f0967e-405f-483e-9992-451a6244bd9b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:50.644130 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-f3f0967e-405f-483e-9992-451a6244bd9b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 6ebc061f-f94f-491b-ab41-a3182c046c61] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:50.651520 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f3f0967e-405f-483e-9992-451a6244bd9b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:50.652098 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f3f0967e-405f-483e-9992-451a6244bd9b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:50.652545 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f3f0967e-405f-483e-9992-451a6244bd9b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:50.653266 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f3f0967e-405f-483e-9992-451a6244bd9b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:50.653722 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f3f0967e-405f-483e-9992-451a6244bd9b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:50.654148 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f3f0967e-405f-483e-9992-451a6244bd9b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:50.658617 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:47:50.799487 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-f3f0967e-405f-483e-9992-451a6244bd9b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:50.808108 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-f3f0967e-405f-483e-9992-451a6244bd9b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61" status: 200 len: 1319 microversion: 2.1 time: 0.168684 Aug 24 13:47:50.808730 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 495/1006] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:50 2022] GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:50.993334 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-f0b84383-d218-48ae-a12c-474cc8a1dc38 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:50.993952 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-f0b84383-d218-48ae-a12c-474cc8a1dc38 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:51.002037 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f0b84383-d218-48ae-a12c-474cc8a1dc38 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:51.002530 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f0b84383-d218-48ae-a12c-474cc8a1dc38 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:51.002966 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f0b84383-d218-48ae-a12c-474cc8a1dc38 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:51.003676 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f0b84383-d218-48ae-a12c-474cc8a1dc38 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:51.004130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f0b84383-d218-48ae-a12c-474cc8a1dc38 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:51.004577 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f0b84383-d218-48ae-a12c-474cc8a1dc38 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:51.232269 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f0b84383-d218-48ae-a12c-474cc8a1dc38 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:51.240059 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-f0b84383-d218-48ae-a12c-474cc8a1dc38 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41" status: 200 len: 1265 microversion: 2.1 time: 0.250917 Aug 24 13:47:51.242157 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 512/1007] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:50 2022] GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:51.505838 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e5349fdc-0fe3-46f9-9518-790b3434ae65 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:51.506471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-e5349fdc-0fe3-46f9-9518-790b3434ae65 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:51.513542 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e5349fdc-0fe3-46f9-9518-790b3434ae65 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:51.514044 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e5349fdc-0fe3-46f9-9518-790b3434ae65 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:51.514482 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e5349fdc-0fe3-46f9-9518-790b3434ae65 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:51.515189 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e5349fdc-0fe3-46f9-9518-790b3434ae65 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:51.515647 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e5349fdc-0fe3-46f9-9518-790b3434ae65 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:51.516076 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e5349fdc-0fe3-46f9-9518-790b3434ae65 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:51.696124 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e5349fdc-0fe3-46f9-9518-790b3434ae65 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:51.704503 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-e5349fdc-0fe3-46f9-9518-790b3434ae65 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1721 microversion: 2.1 time: 0.204298 Aug 24 13:47:51.705069 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 496/1008] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:51 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:51.838801 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b2e166a0-1adb-4a4b-9a71-95272dd59a6a tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:51.839752 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b2e166a0-1adb-4a4b-9a71-95272dd59a6a tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 6ebc061f-f94f-491b-ab41-a3182c046c61] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:51.848593 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b2e166a0-1adb-4a4b-9a71-95272dd59a6a tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:51.849757 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b2e166a0-1adb-4a4b-9a71-95272dd59a6a tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:51.851056 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b2e166a0-1adb-4a4b-9a71-95272dd59a6a tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:51.852107 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b2e166a0-1adb-4a4b-9a71-95272dd59a6a tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:51.853114 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b2e166a0-1adb-4a4b-9a71-95272dd59a6a tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:51.853705 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b2e166a0-1adb-4a4b-9a71-95272dd59a6a tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:52.039237 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b2e166a0-1adb-4a4b-9a71-95272dd59a6a tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:52.047464 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b2e166a0-1adb-4a4b-9a71-95272dd59a6a tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61" status: 200 len: 1319 microversion: 2.1 time: 0.221498 Aug 24 13:47:52.054335 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 513/1009] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:51 2022] GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:52.151811 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-599310b2-5d7d-4b48-bb5a-7d3faf3d03d1 req-8373552a-ca79-4786-8b36-44d3469e493e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6731688e-fae7-4e0d-ba98-11b4aa105a41", "tag": "6974fab0-e16f-4683-b4b3-3d4218fb55a8"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:47:52.161268 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-599310b2-5d7d-4b48-bb5a-7d3faf3d03d1 req-8373552a-ca79-4786-8b36-44d3469e493e service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:52.161750 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-599310b2-5d7d-4b48-bb5a-7d3faf3d03d1 req-8373552a-ca79-4786-8b36-44d3469e493e service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:52.162174 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-599310b2-5d7d-4b48-bb5a-7d3faf3d03d1 req-8373552a-ca79-4786-8b36-44d3469e493e service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:52.180135 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-599310b2-5d7d-4b48-bb5a-7d3faf3d03d1 req-8373552a-ca79-4786-8b36-44d3469e493e service nova] Creating event network-changed:6974fab0-e16f-4683-b4b3-3d4218fb55a8 for instance 6731688e-fae7-4e0d-ba98-11b4aa105a41 on hv-cinder-77957 Aug 24 13:47:52.185127 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-599310b2-5d7d-4b48-bb5a-7d3faf3d03d1 req-8373552a-ca79-4786-8b36-44d3469e493e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036865 Aug 24 13:47:52.188257 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 497/1010] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:47:52.262830 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a42900dc-76f1-4c55-89ae-87d0cbaaa702 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:52.263446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-a42900dc-76f1-4c55-89ae-87d0cbaaa702 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:52.270473 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a42900dc-76f1-4c55-89ae-87d0cbaaa702 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:52.271063 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a42900dc-76f1-4c55-89ae-87d0cbaaa702 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:52.271571 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a42900dc-76f1-4c55-89ae-87d0cbaaa702 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:52.272915 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a42900dc-76f1-4c55-89ae-87d0cbaaa702 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:52.273378 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a42900dc-76f1-4c55-89ae-87d0cbaaa702 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:52.273798 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a42900dc-76f1-4c55-89ae-87d0cbaaa702 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:52.728751 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-04a7cbbb-4117-4932-a6b0-85761f7cf79a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:52.729470 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-04a7cbbb-4117-4932-a6b0-85761f7cf79a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:52.736122 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-04a7cbbb-4117-4932-a6b0-85761f7cf79a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:52.736652 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-04a7cbbb-4117-4932-a6b0-85761f7cf79a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:52.737095 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-04a7cbbb-4117-4932-a6b0-85761f7cf79a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:52.737881 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-04a7cbbb-4117-4932-a6b0-85761f7cf79a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:52.738576 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-04a7cbbb-4117-4932-a6b0-85761f7cf79a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:52.739007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-04a7cbbb-4117-4932-a6b0-85761f7cf79a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:52.750222 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-a42900dc-76f1-4c55-89ae-87d0cbaaa702 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:52.758967 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a42900dc-76f1-4c55-89ae-87d0cbaaa702 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41" status: 200 len: 1265 microversion: 2.1 time: 0.499959 Aug 24 13:47:52.759559 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 514/1011] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:52 2022] GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 => generated 1265 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:52.895586 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-04a7cbbb-4117-4932-a6b0-85761f7cf79a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:52.904765 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-04a7cbbb-4117-4932-a6b0-85761f7cf79a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1698 microversion: 2.1 time: 0.181500 Aug 24 13:47:52.905326 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 498/1012] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:52 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1698 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:47:52.925440 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a7137526-c532-458d-87da-94ad3f54fb96 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:47:52.932143 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a7137526-c532-458d-87da-94ad3f54fb96 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:52.932666 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a7137526-c532-458d-87da-94ad3f54fb96 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:52.933130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a7137526-c532-458d-87da-94ad3f54fb96 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:52.956232 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-a7137526-c532-458d-87da-94ad3f54fb96 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Going to try to start instance {{(pid=133015) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 13:47:53.074741 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-821e3ca9-3ece-42be-91d1-80bcc2c85846 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:53.075723 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-821e3ca9-3ece-42be-91d1-80bcc2c85846 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 6ebc061f-f94f-491b-ab41-a3182c046c61] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:53.084110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-821e3ca9-3ece-42be-91d1-80bcc2c85846 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:53.085248 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-821e3ca9-3ece-42be-91d1-80bcc2c85846 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:53.085698 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-821e3ca9-3ece-42be-91d1-80bcc2c85846 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:53.086421 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-821e3ca9-3ece-42be-91d1-80bcc2c85846 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:53.086886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-821e3ca9-3ece-42be-91d1-80bcc2c85846 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:53.087318 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-821e3ca9-3ece-42be-91d1-80bcc2c85846 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:53.156553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a7137526-c532-458d-87da-94ad3f54fb96 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "POST /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a/action" status: 202 len: 0 microversion: 2.1 time: 0.234815 Aug 24 13:47:53.157868 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 515/1013] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 13:47:52 2022] POST /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:47:53.166191 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-f4da8871-fe75-403c-b75f-bc3ca25bf6a5 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:53.166894 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-f4da8871-fe75-403c-b75f-bc3ca25bf6a5 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:53.173579 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f4da8871-fe75-403c-b75f-bc3ca25bf6a5 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:53.174067 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f4da8871-fe75-403c-b75f-bc3ca25bf6a5 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:53.174597 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f4da8871-fe75-403c-b75f-bc3ca25bf6a5 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:53.175442 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f4da8871-fe75-403c-b75f-bc3ca25bf6a5 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:53.175900 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f4da8871-fe75-403c-b75f-bc3ca25bf6a5 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:53.176518 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f4da8871-fe75-403c-b75f-bc3ca25bf6a5 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:53.341533 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-821e3ca9-3ece-42be-91d1-80bcc2c85846 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:53.350765 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-821e3ca9-3ece-42be-91d1-80bcc2c85846 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61" status: 200 len: 1507 microversion: 2.1 time: 0.281277 Aug 24 13:47:53.351856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 499/1014] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:53 2022] GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61 => generated 1507 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:47:53.411222 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f4da8871-fe75-403c-b75f-bc3ca25bf6a5 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:53.421187 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-f4da8871-fe75-403c-b75f-bc3ca25bf6a5 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1707 microversion: 2.1 time: 0.259252 Aug 24 13:47:53.436681 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 516/1015] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:53 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1707 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:53.781633 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-de2f4346-74b1-4122-b829-9f9867d28860 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:53.782410 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-de2f4346-74b1-4122-b829-9f9867d28860 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:53.790364 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-de2f4346-74b1-4122-b829-9f9867d28860 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:53.791256 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-de2f4346-74b1-4122-b829-9f9867d28860 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:53.791874 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-de2f4346-74b1-4122-b829-9f9867d28860 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:53.792788 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-de2f4346-74b1-4122-b829-9f9867d28860 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:53.793757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-de2f4346-74b1-4122-b829-9f9867d28860 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:53.794367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-de2f4346-74b1-4122-b829-9f9867d28860 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:53.964304 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-de2f4346-74b1-4122-b829-9f9867d28860 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:53.972909 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-de2f4346-74b1-4122-b829-9f9867d28860 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41" status: 200 len: 1265 microversion: 2.1 time: 0.195794 Aug 24 13:47:53.973800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 500/1016] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:53 2022] GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:54.445368 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-235aeb8d-5549-4d0a-83c0-3ea5bde57cfc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:54.445889 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-235aeb8d-5549-4d0a-83c0-3ea5bde57cfc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:54.452603 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-235aeb8d-5549-4d0a-83c0-3ea5bde57cfc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:54.453089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-235aeb8d-5549-4d0a-83c0-3ea5bde57cfc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:54.453534 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-235aeb8d-5549-4d0a-83c0-3ea5bde57cfc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:54.454215 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-235aeb8d-5549-4d0a-83c0-3ea5bde57cfc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:54.454667 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-235aeb8d-5549-4d0a-83c0-3ea5bde57cfc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:54.455091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-235aeb8d-5549-4d0a-83c0-3ea5bde57cfc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:54.595602 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-235aeb8d-5549-4d0a-83c0-3ea5bde57cfc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:54.604533 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-235aeb8d-5549-4d0a-83c0-3ea5bde57cfc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1707 microversion: 2.1 time: 0.163809 Aug 24 13:47:54.605129 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 517/1017] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:54 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1707 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:54.995295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a72411ae-4a8a-4df3-9c43-651b9fd9644d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:54.996130 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a72411ae-4a8a-4df3-9c43-651b9fd9644d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:55.003310 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a72411ae-4a8a-4df3-9c43-651b9fd9644d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:55.004023 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a72411ae-4a8a-4df3-9c43-651b9fd9644d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:55.004491 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a72411ae-4a8a-4df3-9c43-651b9fd9644d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:55.005284 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a72411ae-4a8a-4df3-9c43-651b9fd9644d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:55.006004 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a72411ae-4a8a-4df3-9c43-651b9fd9644d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:55.006527 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a72411ae-4a8a-4df3-9c43-651b9fd9644d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:55.179105 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-a72411ae-4a8a-4df3-9c43-651b9fd9644d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:55.179105 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a72411ae-4a8a-4df3-9c43-651b9fd9644d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41" status: 200 len: 1265 microversion: 2.1 time: 0.185610 Aug 24 13:47:55.179105 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 501/1018] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:54 2022] GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:55.627644 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-8194278e-db7b-49e3-b624-330f4136ad4a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:55.628286 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-8194278e-db7b-49e3-b624-330f4136ad4a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:55.635525 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8194278e-db7b-49e3-b624-330f4136ad4a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:55.636091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8194278e-db7b-49e3-b624-330f4136ad4a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:55.636554 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8194278e-db7b-49e3-b624-330f4136ad4a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:55.637273 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8194278e-db7b-49e3-b624-330f4136ad4a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:55.637734 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8194278e-db7b-49e3-b624-330f4136ad4a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:55.638166 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8194278e-db7b-49e3-b624-330f4136ad4a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:55.784790 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-8194278e-db7b-49e3-b624-330f4136ad4a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:55.797618 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-8194278e-db7b-49e3-b624-330f4136ad4a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1711 microversion: 2.1 time: 0.173809 Aug 24 13:47:55.798209 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 518/1019] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:55 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1711 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:56.198023 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-729de06c-8019-4792-85ca-b4ef25ad12ce tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:56.198637 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-729de06c-8019-4792-85ca-b4ef25ad12ce tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:56.200733 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=4 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:47:56.207127 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-729de06c-8019-4792-85ca-b4ef25ad12ce tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:56.212343 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-729de06c-8019-4792-85ca-b4ef25ad12ce tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:56.220813 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-729de06c-8019-4792-85ca-b4ef25ad12ce tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:56.220813 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-729de06c-8019-4792-85ca-b4ef25ad12ce tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:56.220813 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-729de06c-8019-4792-85ca-b4ef25ad12ce tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:56.220813 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-729de06c-8019-4792-85ca-b4ef25ad12ce tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:56.388474 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-729de06c-8019-4792-85ca-b4ef25ad12ce tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:56.397381 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-729de06c-8019-4792-85ca-b4ef25ad12ce tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41" status: 200 len: 1265 microversion: 2.1 time: 0.202716 Aug 24 13:47:56.397970 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 502/1020] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:56 2022] GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:47:57.419670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-02ca387c-0428-4617-a1fe-4b84f63a551a tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:57.420234 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-02ca387c-0428-4617-a1fe-4b84f63a551a tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:57.427310 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-02ca387c-0428-4617-a1fe-4b84f63a551a tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:57.428865 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-02ca387c-0428-4617-a1fe-4b84f63a551a tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:57.429491 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-02ca387c-0428-4617-a1fe-4b84f63a551a tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:57.430250 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-02ca387c-0428-4617-a1fe-4b84f63a551a tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:57.430728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-02ca387c-0428-4617-a1fe-4b84f63a551a tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:57.431171 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-02ca387c-0428-4617-a1fe-4b84f63a551a tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:57.572494 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-02ca387c-0428-4617-a1fe-4b84f63a551a tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:57.580619 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-02ca387c-0428-4617-a1fe-4b84f63a551a tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41" status: 200 len: 1265 microversion: 2.1 time: 0.164769 Aug 24 13:47:57.582124 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 519/1021] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:57 2022] GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:58.605821 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-263ef0ba-313d-44e5-855c-aa0ca041f9f0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:58.605821 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-263ef0ba-313d-44e5-855c-aa0ca041f9f0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:58.605821 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=14 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:47:58.611062 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-263ef0ba-313d-44e5-855c-aa0ca041f9f0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:58.611567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-263ef0ba-313d-44e5-855c-aa0ca041f9f0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:58.612010 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-263ef0ba-313d-44e5-855c-aa0ca041f9f0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:58.612843 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-263ef0ba-313d-44e5-855c-aa0ca041f9f0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:58.613302 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-263ef0ba-313d-44e5-855c-aa0ca041f9f0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:58.613737 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-263ef0ba-313d-44e5-855c-aa0ca041f9f0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:58.759714 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-263ef0ba-313d-44e5-855c-aa0ca041f9f0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:58.767599 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-263ef0ba-313d-44e5-855c-aa0ca041f9f0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41" status: 200 len: 1265 microversion: 2.1 time: 0.169573 Aug 24 13:47:58.768269 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 503/1022] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:58 2022] GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:47:59.792160 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-51fbd5a6-ae21-45f4-8156-d7f5273222c0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:47:59.792776 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-51fbd5a6-ae21-45f4-8156-d7f5273222c0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:47:59.799386 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-51fbd5a6-ae21-45f4-8156-d7f5273222c0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:59.799861 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-51fbd5a6-ae21-45f4-8156-d7f5273222c0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:59.800340 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-51fbd5a6-ae21-45f4-8156-d7f5273222c0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:59.801032 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-51fbd5a6-ae21-45f4-8156-d7f5273222c0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:47:59.801478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-51fbd5a6-ae21-45f4-8156-d7f5273222c0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:47:59.801891 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-51fbd5a6-ae21-45f4-8156-d7f5273222c0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:47:59.945652 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-51fbd5a6-ae21-45f4-8156-d7f5273222c0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:47:59.954202 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-51fbd5a6-ae21-45f4-8156-d7f5273222c0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41" status: 200 len: 1265 microversion: 2.1 time: 0.167974 Aug 24 13:47:59.954795 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 520/1023] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:47:59 2022] GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:00.975283 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-97ee9154-f5d5-46d2-82a9-f3f4b19c4728 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:00.975889 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-97ee9154-f5d5-46d2-82a9-f3f4b19c4728 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:00.982472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97ee9154-f5d5-46d2-82a9-f3f4b19c4728 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:00.982957 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97ee9154-f5d5-46d2-82a9-f3f4b19c4728 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:00.983412 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97ee9154-f5d5-46d2-82a9-f3f4b19c4728 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:00.984125 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97ee9154-f5d5-46d2-82a9-f3f4b19c4728 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:00.984605 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97ee9154-f5d5-46d2-82a9-f3f4b19c4728 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:00.985027 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-97ee9154-f5d5-46d2-82a9-f3f4b19c4728 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:01.133211 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-97ee9154-f5d5-46d2-82a9-f3f4b19c4728 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:01.141369 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-97ee9154-f5d5-46d2-82a9-f3f4b19c4728 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41" status: 200 len: 1265 microversion: 2.1 time: 0.169853 Aug 24 13:48:01.141954 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 504/1024] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:00 2022] GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:02.179789 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-e59804a8-3c92-489a-87bc-8058667ee8c1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:02.182931 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-e59804a8-3c92-489a-87bc-8058667ee8c1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:02.191091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_api:SELECT=66 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:48:02.196215 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e59804a8-3c92-489a-87bc-8058667ee8c1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:02.196808 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e59804a8-3c92-489a-87bc-8058667ee8c1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:02.197251 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e59804a8-3c92-489a-87bc-8058667ee8c1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:02.198000 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e59804a8-3c92-489a-87bc-8058667ee8c1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:02.198519 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e59804a8-3c92-489a-87bc-8058667ee8c1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:02.199124 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-e59804a8-3c92-489a-87bc-8058667ee8c1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:02.409285 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-e59804a8-3c92-489a-87bc-8058667ee8c1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:02.417820 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-e59804a8-3c92-489a-87bc-8058667ee8c1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41" status: 200 len: 1265 microversion: 2.1 time: 0.258662 Aug 24 13:48:02.419184 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 521/1025] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:02 2022] GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:02.659828 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-1b1dd9b4-33ee-4624-a5e9-e754b6147570 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:48:02.662203 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-1b1dd9b4-33ee-4624-a5e9-e754b6147570 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:02.672922 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1b1dd9b4-33ee-4624-a5e9-e754b6147570 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:02.673881 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1b1dd9b4-33ee-4624-a5e9-e754b6147570 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:02.674342 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1b1dd9b4-33ee-4624-a5e9-e754b6147570 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:02.675062 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1b1dd9b4-33ee-4624-a5e9-e754b6147570 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:02.675579 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1b1dd9b4-33ee-4624-a5e9-e754b6147570 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:02.676010 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1b1dd9b4-33ee-4624-a5e9-e754b6147570 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:02.934897 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-1b1dd9b4-33ee-4624-a5e9-e754b6147570 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "POST /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024/action" status: 202 len: 0 microversion: 2.1 time: 0.278668 Aug 24 13:48:02.936696 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 505/1026] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 13:48:02 2022] POST /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:48:02.946067 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-33d8da47-e9d5-48e1-8f1c-fc4f3fae22d1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:02.946786 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-33d8da47-e9d5-48e1-8f1c-fc4f3fae22d1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:02.954077 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-33d8da47-e9d5-48e1-8f1c-fc4f3fae22d1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:02.956287 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-33d8da47-e9d5-48e1-8f1c-fc4f3fae22d1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:02.956755 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-33d8da47-e9d5-48e1-8f1c-fc4f3fae22d1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:02.957497 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-33d8da47-e9d5-48e1-8f1c-fc4f3fae22d1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:02.957957 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-33d8da47-e9d5-48e1-8f1c-fc4f3fae22d1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:02.958389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-33d8da47-e9d5-48e1-8f1c-fc4f3fae22d1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:03.129322 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-33d8da47-e9d5-48e1-8f1c-fc4f3fae22d1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:03.140130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-33d8da47-e9d5-48e1-8f1c-fc4f3fae22d1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1752 microversion: 2.1 time: 0.200263 Aug 24 13:48:03.140801 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 522/1027] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:02 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1752 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:03.442036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-cb17656b-876f-46ba-bb89-6cf54f578df1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:03.442833 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-cb17656b-876f-46ba-bb89-6cf54f578df1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:03.450113 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cb17656b-876f-46ba-bb89-6cf54f578df1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:03.450815 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cb17656b-876f-46ba-bb89-6cf54f578df1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:03.451355 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cb17656b-876f-46ba-bb89-6cf54f578df1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:03.452935 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cb17656b-876f-46ba-bb89-6cf54f578df1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:03.453727 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cb17656b-876f-46ba-bb89-6cf54f578df1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:03.454340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cb17656b-876f-46ba-bb89-6cf54f578df1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:03.562401 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-d212d0f1-66a0-4d6a-917d-a9fc0df58638 req-a1fc3f42-465a-4e61-a5e7-ccaec703b149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6731688e-fae7-4e0d-ba98-11b4aa105a41", "name": "network-vif-plugged", "status": "completed", "tag": "6974fab0-e16f-4683-b4b3-3d4218fb55a8"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:48:03.577641 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-d212d0f1-66a0-4d6a-917d-a9fc0df58638 req-a1fc3f42-465a-4e61-a5e7-ccaec703b149 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:03.578116 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-d212d0f1-66a0-4d6a-917d-a9fc0df58638 req-a1fc3f42-465a-4e61-a5e7-ccaec703b149 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:03.578544 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-d212d0f1-66a0-4d6a-917d-a9fc0df58638 req-a1fc3f42-465a-4e61-a5e7-ccaec703b149 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:03.603523 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-d212d0f1-66a0-4d6a-917d-a9fc0df58638 req-a1fc3f42-465a-4e61-a5e7-ccaec703b149 service nova] Creating event network-vif-plugged:6974fab0-e16f-4683-b4b3-3d4218fb55a8 for instance 6731688e-fae7-4e0d-ba98-11b4aa105a41 on hv-cinder-77957 Aug 24 13:48:03.611704 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-d212d0f1-66a0-4d6a-917d-a9fc0df58638 req-a1fc3f42-465a-4e61-a5e7-ccaec703b149 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056783 Aug 24 13:48:03.612702 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 523/1028] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:48:03.643764 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-cb17656b-876f-46ba-bb89-6cf54f578df1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:03.652813 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-cb17656b-876f-46ba-bb89-6cf54f578df1 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41" status: 200 len: 1265 microversion: 2.1 time: 0.215267 Aug 24 13:48:03.656617 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 506/1029] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:03 2022] GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:04.164550 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-5c6a3a45-7ca2-4324-979d-d864f8293400 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:04.165275 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-5c6a3a45-7ca2-4324-979d-d864f8293400 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:04.173159 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5c6a3a45-7ca2-4324-979d-d864f8293400 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:04.173947 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5c6a3a45-7ca2-4324-979d-d864f8293400 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:04.174403 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5c6a3a45-7ca2-4324-979d-d864f8293400 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:04.175178 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5c6a3a45-7ca2-4324-979d-d864f8293400 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:04.175764 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5c6a3a45-7ca2-4324-979d-d864f8293400 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:04.176289 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5c6a3a45-7ca2-4324-979d-d864f8293400 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:04.182415 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:48:04.341553 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-5c6a3a45-7ca2-4324-979d-d864f8293400 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:04.352362 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-5c6a3a45-7ca2-4324-979d-d864f8293400 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1757 microversion: 2.1 time: 0.192596 Aug 24 13:48:04.352969 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 524/1030] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:04 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:04.676162 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-f88b49ae-0f0d-4456-b0cb-eef08f0b13c0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:04.676728 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-f88b49ae-0f0d-4456-b0cb-eef08f0b13c0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:04.684028 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f88b49ae-0f0d-4456-b0cb-eef08f0b13c0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:04.684550 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f88b49ae-0f0d-4456-b0cb-eef08f0b13c0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:04.684986 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f88b49ae-0f0d-4456-b0cb-eef08f0b13c0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:04.685688 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f88b49ae-0f0d-4456-b0cb-eef08f0b13c0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:04.686145 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f88b49ae-0f0d-4456-b0cb-eef08f0b13c0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:04.686603 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f88b49ae-0f0d-4456-b0cb-eef08f0b13c0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:04.834808 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-f88b49ae-0f0d-4456-b0cb-eef08f0b13c0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:04.842794 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-f88b49ae-0f0d-4456-b0cb-eef08f0b13c0 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41" status: 200 len: 1265 microversion: 2.1 time: 0.170656 Aug 24 13:48:04.843359 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 507/1031] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:04 2022] GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:05.375095 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-f5d1b739-048f-43b7-ab71-0a0cf7e55ada tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:05.375696 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-f5d1b739-048f-43b7-ab71-0a0cf7e55ada tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:05.383605 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f5d1b739-048f-43b7-ab71-0a0cf7e55ada tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:05.384092 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f5d1b739-048f-43b7-ab71-0a0cf7e55ada tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:05.384555 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f5d1b739-048f-43b7-ab71-0a0cf7e55ada tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:05.385265 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f5d1b739-048f-43b7-ab71-0a0cf7e55ada tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:05.385717 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f5d1b739-048f-43b7-ab71-0a0cf7e55ada tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:05.386135 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f5d1b739-048f-43b7-ab71-0a0cf7e55ada tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:05.544102 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f5d1b739-048f-43b7-ab71-0a0cf7e55ada tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:05.552728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-f5d1b739-048f-43b7-ab71-0a0cf7e55ada tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1757 microversion: 2.1 time: 0.182255 Aug 24 13:48:05.553256 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 525/1032] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:05 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:05.864246 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-ac9a43c6-09e4-435d-9cab-0e8650c400d9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:05.864869 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-ac9a43c6-09e4-435d-9cab-0e8650c400d9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:05.867424 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:48:05.872202 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ac9a43c6-09e4-435d-9cab-0e8650c400d9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:05.872768 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ac9a43c6-09e4-435d-9cab-0e8650c400d9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:05.873204 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ac9a43c6-09e4-435d-9cab-0e8650c400d9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:05.873895 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ac9a43c6-09e4-435d-9cab-0e8650c400d9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:05.874349 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ac9a43c6-09e4-435d-9cab-0e8650c400d9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:05.874779 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-ac9a43c6-09e4-435d-9cab-0e8650c400d9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:06.013787 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-ac9a43c6-09e4-435d-9cab-0e8650c400d9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:06.021701 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-ac9a43c6-09e4-435d-9cab-0e8650c400d9 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41" status: 200 len: 1265 microversion: 2.1 time: 0.162099 Aug 24 13:48:06.022443 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 508/1033] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:05 2022] GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:06.575417 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-547b8bd7-38ac-4877-ba13-a6c7e78089df tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:06.576035 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-547b8bd7-38ac-4877-ba13-a6c7e78089df tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:06.582676 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-547b8bd7-38ac-4877-ba13-a6c7e78089df tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:06.583162 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-547b8bd7-38ac-4877-ba13-a6c7e78089df tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:06.583940 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-547b8bd7-38ac-4877-ba13-a6c7e78089df tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:06.584837 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-547b8bd7-38ac-4877-ba13-a6c7e78089df tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:06.585336 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-547b8bd7-38ac-4877-ba13-a6c7e78089df tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:06.585770 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-547b8bd7-38ac-4877-ba13-a6c7e78089df tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:06.741227 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-547b8bd7-38ac-4877-ba13-a6c7e78089df tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:06.749755 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-547b8bd7-38ac-4877-ba13-a6c7e78089df tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1757 microversion: 2.1 time: 0.178100 Aug 24 13:48:06.750343 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 526/1034] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:06 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:07.042784 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-8715b0c4-1ac0-4dcd-858b-603f67ff6725 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:07.043416 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-8715b0c4-1ac0-4dcd-858b-603f67ff6725 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:07.050160 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8715b0c4-1ac0-4dcd-858b-603f67ff6725 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:07.050646 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8715b0c4-1ac0-4dcd-858b-603f67ff6725 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:07.051089 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8715b0c4-1ac0-4dcd-858b-603f67ff6725 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:07.051788 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8715b0c4-1ac0-4dcd-858b-603f67ff6725 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:07.052360 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8715b0c4-1ac0-4dcd-858b-603f67ff6725 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:07.053337 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8715b0c4-1ac0-4dcd-858b-603f67ff6725 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:07.184433 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-8715b0c4-1ac0-4dcd-858b-603f67ff6725 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:07.192477 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-8715b0c4-1ac0-4dcd-858b-603f67ff6725 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41" status: 200 len: 1451 microversion: 2.1 time: 0.153541 Aug 24 13:48:07.193573 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 509/1035] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:07 2022] GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:07.213509 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-aca83ba7-0b0e-44c6-8045-a21de835f101 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:07.214146 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-aca83ba7-0b0e-44c6-8045-a21de835f101 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:07.220039 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aca83ba7-0b0e-44c6-8045-a21de835f101 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:07.220540 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aca83ba7-0b0e-44c6-8045-a21de835f101 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:07.220971 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aca83ba7-0b0e-44c6-8045-a21de835f101 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:07.221642 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aca83ba7-0b0e-44c6-8045-a21de835f101 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:07.222087 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aca83ba7-0b0e-44c6-8045-a21de835f101 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:07.222502 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aca83ba7-0b0e-44c6-8045-a21de835f101 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:07.365460 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-aca83ba7-0b0e-44c6-8045-a21de835f101 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:07.374168 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-aca83ba7-0b0e-44c6-8045-a21de835f101 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41" status: 200 len: 1451 microversion: 2.1 time: 0.164939 Aug 24 13:48:07.374750 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 527/1036] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:07 2022] GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:07.771185 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-df9edf17-1126-43e8-95c2-096241a9111c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:07.772653 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-df9edf17-1126-43e8-95c2-096241a9111c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:07.778647 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-df9edf17-1126-43e8-95c2-096241a9111c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:07.779126 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-df9edf17-1126-43e8-95c2-096241a9111c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:07.779553 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-df9edf17-1126-43e8-95c2-096241a9111c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:07.780269 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-df9edf17-1126-43e8-95c2-096241a9111c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:07.780724 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-df9edf17-1126-43e8-95c2-096241a9111c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:07.781141 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-df9edf17-1126-43e8-95c2-096241a9111c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:07.936471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-df9edf17-1126-43e8-95c2-096241a9111c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:07.945801 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-df9edf17-1126-43e8-95c2-096241a9111c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1757 microversion: 2.1 time: 0.178710 Aug 24 13:48:07.946387 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 510/1037] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:07 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:08.969300 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-f80851cf-cac5-4a10-8593-ee43de073ff5 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:08.969956 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-f80851cf-cac5-4a10-8593-ee43de073ff5 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:08.977638 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f80851cf-cac5-4a10-8593-ee43de073ff5 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:08.978160 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f80851cf-cac5-4a10-8593-ee43de073ff5 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:08.978604 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f80851cf-cac5-4a10-8593-ee43de073ff5 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:08.979314 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f80851cf-cac5-4a10-8593-ee43de073ff5 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:08.979823 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f80851cf-cac5-4a10-8593-ee43de073ff5 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:08.980280 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f80851cf-cac5-4a10-8593-ee43de073ff5 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:09.129568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f80851cf-cac5-4a10-8593-ee43de073ff5 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:09.139431 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-f80851cf-cac5-4a10-8593-ee43de073ff5 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1757 microversion: 2.1 time: 0.175694 Aug 24 13:48:09.140018 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 528/1038] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:08 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:09.345675 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-17e76499-73b6-45cf-a47c-c2e59b42082f req-d16fd7ff-3d88-48fd-8802-fda6ba6ef211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6731688e-fae7-4e0d-ba98-11b4aa105a41", "tag": "6974fab0-e16f-4683-b4b3-3d4218fb55a8"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:48:09.356781 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-17e76499-73b6-45cf-a47c-c2e59b42082f req-d16fd7ff-3d88-48fd-8802-fda6ba6ef211 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:09.357351 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-17e76499-73b6-45cf-a47c-c2e59b42082f req-d16fd7ff-3d88-48fd-8802-fda6ba6ef211 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:09.357846 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-17e76499-73b6-45cf-a47c-c2e59b42082f req-d16fd7ff-3d88-48fd-8802-fda6ba6ef211 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:09.369846 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-17e76499-73b6-45cf-a47c-c2e59b42082f req-d16fd7ff-3d88-48fd-8802-fda6ba6ef211 service nova] Creating event network-changed:6974fab0-e16f-4683-b4b3-3d4218fb55a8 for instance 6731688e-fae7-4e0d-ba98-11b4aa105a41 on hv-cinder-77957 Aug 24 13:48:09.375063 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-17e76499-73b6-45cf-a47c-c2e59b42082f req-d16fd7ff-3d88-48fd-8802-fda6ba6ef211 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033298 Aug 24 13:48:09.375796 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 511/1039] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:48:10.170047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-476d8356-7fb1-46b5-9b36-f58011b11348 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:10.171409 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-476d8356-7fb1-46b5-9b36-f58011b11348 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:10.180402 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-476d8356-7fb1-46b5-9b36-f58011b11348 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:10.181190 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-476d8356-7fb1-46b5-9b36-f58011b11348 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:10.181829 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-476d8356-7fb1-46b5-9b36-f58011b11348 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:10.182548 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-476d8356-7fb1-46b5-9b36-f58011b11348 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:10.183013 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-476d8356-7fb1-46b5-9b36-f58011b11348 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:10.183687 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-476d8356-7fb1-46b5-9b36-f58011b11348 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:10.344388 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-476d8356-7fb1-46b5-9b36-f58011b11348 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:10.352837 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-476d8356-7fb1-46b5-9b36-f58011b11348 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1757 microversion: 2.1 time: 0.187172 Aug 24 13:48:10.353424 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 529/1040] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:10 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:11.375782 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-9ce3b97e-bea8-4b29-932a-73795865b5bb tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:11.376494 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-9ce3b97e-bea8-4b29-932a-73795865b5bb tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:11.386520 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9ce3b97e-bea8-4b29-932a-73795865b5bb tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:11.387085 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9ce3b97e-bea8-4b29-932a-73795865b5bb tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:11.387569 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9ce3b97e-bea8-4b29-932a-73795865b5bb tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:11.388485 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9ce3b97e-bea8-4b29-932a-73795865b5bb tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:11.388956 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9ce3b97e-bea8-4b29-932a-73795865b5bb tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:11.389386 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9ce3b97e-bea8-4b29-932a-73795865b5bb tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:11.394088 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:48:11.541553 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-9ce3b97e-bea8-4b29-932a-73795865b5bb tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:11.550218 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-9ce3b97e-bea8-4b29-932a-73795865b5bb tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1757 microversion: 2.1 time: 0.179159 Aug 24 13:48:11.550796 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 512/1041] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:11 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:12.160807 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-1244f54b-0918-4541-8672-460763fa3c10 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "366d6152-eaeb-4748-9bed-0fa4ce05c497", "device": "/dev/sdb"}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:48:12.164421 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-1244f54b-0918-4541-8672-460763fa3c10 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 6ebc061f-f94f-491b-ab41-a3182c046c61] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:12.170889 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1244f54b-0918-4541-8672-460763fa3c10 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:12.171337 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1244f54b-0918-4541-8672-460763fa3c10 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:12.171774 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1244f54b-0918-4541-8672-460763fa3c10 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:12.172497 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1244f54b-0918-4541-8672-460763fa3c10 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:12.172952 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1244f54b-0918-4541-8672-460763fa3c10 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:12.173370 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1244f54b-0918-4541-8672-460763fa3c10 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:12.571637 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-e4a42587-9cba-4adc-9fcd-1b8b1ca0e9e9 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:12.572324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-e4a42587-9cba-4adc-9fcd-1b8b1ca0e9e9 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:12.578931 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e4a42587-9cba-4adc-9fcd-1b8b1ca0e9e9 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:12.579432 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e4a42587-9cba-4adc-9fcd-1b8b1ca0e9e9 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:12.579968 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e4a42587-9cba-4adc-9fcd-1b8b1ca0e9e9 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:12.580692 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e4a42587-9cba-4adc-9fcd-1b8b1ca0e9e9 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:12.581146 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e4a42587-9cba-4adc-9fcd-1b8b1ca0e9e9 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:12.581570 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-e4a42587-9cba-4adc-9fcd-1b8b1ca0e9e9 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:12.737199 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-e4a42587-9cba-4adc-9fcd-1b8b1ca0e9e9 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:12.746018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-e4a42587-9cba-4adc-9fcd-1b8b1ca0e9e9 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1757 microversion: 2.1 time: 0.178181 Aug 24 13:48:12.746611 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 513/1042] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:12 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:48:13.202227 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-1244f54b-0918-4541-8672-460763fa3c10 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "POST /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.045251 Aug 24 13:48:13.203021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 530/1043] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 13:48:12 2022] POST /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61/os-volume_attachments => generated 194 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:48:13.769020 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-65c40b0f-6de0-4f98-953f-27be71e8dd98 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:13.769637 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-65c40b0f-6de0-4f98-953f-27be71e8dd98 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:13.777074 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-65c40b0f-6de0-4f98-953f-27be71e8dd98 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:13.777555 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-65c40b0f-6de0-4f98-953f-27be71e8dd98 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:13.777988 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-65c40b0f-6de0-4f98-953f-27be71e8dd98 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:13.778673 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-65c40b0f-6de0-4f98-953f-27be71e8dd98 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:13.779128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-65c40b0f-6de0-4f98-953f-27be71e8dd98 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:13.779552 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-65c40b0f-6de0-4f98-953f-27be71e8dd98 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:13.978219 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-65c40b0f-6de0-4f98-953f-27be71e8dd98 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:13.986511 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-65c40b0f-6de0-4f98-953f-27be71e8dd98 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1757 microversion: 2.1 time: 0.221333 Aug 24 13:48:13.987080 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 514/1044] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:13 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1757 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:15.012559 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a397e991-6423-4101-9fe8-a6762d462aaa tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:15.012559 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-a397e991-6423-4101-9fe8-a6762d462aaa tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:15.017192 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a397e991-6423-4101-9fe8-a6762d462aaa tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:15.017670 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a397e991-6423-4101-9fe8-a6762d462aaa tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:15.018190 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a397e991-6423-4101-9fe8-a6762d462aaa tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:15.019322 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a397e991-6423-4101-9fe8-a6762d462aaa tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:15.019322 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a397e991-6423-4101-9fe8-a6762d462aaa tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:15.019709 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a397e991-6423-4101-9fe8-a6762d462aaa tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:15.173466 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-a397e991-6423-4101-9fe8-a6762d462aaa tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:15.183029 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a397e991-6423-4101-9fe8-a6762d462aaa tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1757 microversion: 2.1 time: 0.178031 Aug 24 13:48:15.183614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 531/1045] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:15 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:16.204071 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-9cf1a239-4970-4800-93fb-84947de7439c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:16.204755 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-9cf1a239-4970-4800-93fb-84947de7439c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:16.211998 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9cf1a239-4970-4800-93fb-84947de7439c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:16.212519 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9cf1a239-4970-4800-93fb-84947de7439c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:16.212963 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9cf1a239-4970-4800-93fb-84947de7439c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:16.213672 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9cf1a239-4970-4800-93fb-84947de7439c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:16.214133 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9cf1a239-4970-4800-93fb-84947de7439c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:16.214638 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9cf1a239-4970-4800-93fb-84947de7439c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:16.368414 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-9cf1a239-4970-4800-93fb-84947de7439c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:16.377125 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-9cf1a239-4970-4800-93fb-84947de7439c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1757 microversion: 2.1 time: 0.176998 Aug 24 13:48:16.377712 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 515/1046] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:16 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:17.399227 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-4b7e9577-be55-4c7b-b906-588e15a9fddc tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:17.399765 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-4b7e9577-be55-4c7b-b906-588e15a9fddc tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:17.406285 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4b7e9577-be55-4c7b-b906-588e15a9fddc tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:17.406765 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4b7e9577-be55-4c7b-b906-588e15a9fddc tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:17.407195 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4b7e9577-be55-4c7b-b906-588e15a9fddc tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:17.407889 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4b7e9577-be55-4c7b-b906-588e15a9fddc tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:17.408378 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4b7e9577-be55-4c7b-b906-588e15a9fddc tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:17.408801 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4b7e9577-be55-4c7b-b906-588e15a9fddc tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:17.565825 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-4b7e9577-be55-4c7b-b906-588e15a9fddc tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:17.574712 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-4b7e9577-be55-4c7b-b906-588e15a9fddc tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1757 microversion: 2.1 time: 0.179866 Aug 24 13:48:17.575304 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 532/1047] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:17 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:18.599791 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-3dde271e-8a02-4a5e-8db0-e69125521c7b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:18.600456 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-3dde271e-8a02-4a5e-8db0-e69125521c7b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:18.606906 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3dde271e-8a02-4a5e-8db0-e69125521c7b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:18.608543 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3dde271e-8a02-4a5e-8db0-e69125521c7b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:18.608543 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3dde271e-8a02-4a5e-8db0-e69125521c7b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:18.608543 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3dde271e-8a02-4a5e-8db0-e69125521c7b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:18.609028 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3dde271e-8a02-4a5e-8db0-e69125521c7b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:18.609450 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3dde271e-8a02-4a5e-8db0-e69125521c7b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:18.776144 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3dde271e-8a02-4a5e-8db0-e69125521c7b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:18.784602 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-3dde271e-8a02-4a5e-8db0-e69125521c7b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1757 microversion: 2.1 time: 0.189273 Aug 24 13:48:18.785172 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 516/1048] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:18 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:19.807151 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-40d0a802-afdd-4cd0-bba9-98451729df54 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:19.807760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-40d0a802-afdd-4cd0-bba9-98451729df54 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:19.814178 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-40d0a802-afdd-4cd0-bba9-98451729df54 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:19.814644 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-40d0a802-afdd-4cd0-bba9-98451729df54 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:19.815072 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-40d0a802-afdd-4cd0-bba9-98451729df54 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:19.815747 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-40d0a802-afdd-4cd0-bba9-98451729df54 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:19.816478 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-40d0a802-afdd-4cd0-bba9-98451729df54 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:19.816890 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-40d0a802-afdd-4cd0-bba9-98451729df54 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:19.960513 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-40d0a802-afdd-4cd0-bba9-98451729df54 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:19.969049 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-40d0a802-afdd-4cd0-bba9-98451729df54 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1757 microversion: 2.1 time: 0.166600 Aug 24 13:48:19.969633 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 533/1049] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:19 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:20.991981 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-5e121de6-0350-4807-8d1c-95909cdf165b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:20.992549 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-5e121de6-0350-4807-8d1c-95909cdf165b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:20.999003 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5e121de6-0350-4807-8d1c-95909cdf165b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:20.999491 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5e121de6-0350-4807-8d1c-95909cdf165b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:20.999929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5e121de6-0350-4807-8d1c-95909cdf165b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:21.000656 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5e121de6-0350-4807-8d1c-95909cdf165b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:21.001116 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5e121de6-0350-4807-8d1c-95909cdf165b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:21.001541 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5e121de6-0350-4807-8d1c-95909cdf165b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:21.147119 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-5e121de6-0350-4807-8d1c-95909cdf165b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:21.155368 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-5e121de6-0350-4807-8d1c-95909cdf165b tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1760 microversion: 2.1 time: 0.168400 Aug 24 13:48:21.155930 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 517/1050] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:20 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1760 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:39.941126 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-8320ef48-2cba-4d0c-a0df-450edc0965ca tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:39.941930 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-8320ef48-2cba-4d0c-a0df-450edc0965ca tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 6ebc061f-f94f-491b-ab41-a3182c046c61] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:39.944684 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_api:SELECT=25 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:48:39.945361 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:48:39.950305 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8320ef48-2cba-4d0c-a0df-450edc0965ca tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:39.950794 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8320ef48-2cba-4d0c-a0df-450edc0965ca tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:39.954137 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8320ef48-2cba-4d0c-a0df-450edc0965ca tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:39.954137 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8320ef48-2cba-4d0c-a0df-450edc0965ca tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:39.954137 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8320ef48-2cba-4d0c-a0df-450edc0965ca tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:39.954137 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8320ef48-2cba-4d0c-a0df-450edc0965ca tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:40.036929 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.objects.instance [None req-8320ef48-2cba-4d0c-a0df-450edc0965ca tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lazy-loading 'services' on Instance uuid 6ebc061f-f94f-491b-ab41-a3182c046c61 {{(pid=133015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:48:40.237344 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-8320ef48-2cba-4d0c-a0df-450edc0965ca tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61/os-volume_attachments/366d6152-eaeb-4748-9bed-0fa4ce05c497" status: 202 len: 0 microversion: 2.1 time: 0.299941 Aug 24 13:48:40.237945 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 534/1051] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 13:48:39 2022] DELETE /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61/os-volume_attachments/366d6152-eaeb-4748-9bed-0fa4ce05c497 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 13:48:42.419454 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-37934107-b8a9-434f-8da2-7f6f0f8ff53b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:42.420057 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-37934107-b8a9-434f-8da2-7f6f0f8ff53b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 6ebc061f-f94f-491b-ab41-a3182c046c61] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:42.422170 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_api:SELECT=19 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:48:42.422822 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=34 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:48:42.427709 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-37934107-b8a9-434f-8da2-7f6f0f8ff53b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:42.428213 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-37934107-b8a9-434f-8da2-7f6f0f8ff53b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:42.428655 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-37934107-b8a9-434f-8da2-7f6f0f8ff53b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:42.429357 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-37934107-b8a9-434f-8da2-7f6f0f8ff53b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:42.429810 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-37934107-b8a9-434f-8da2-7f6f0f8ff53b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:42.430234 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-37934107-b8a9-434f-8da2-7f6f0f8ff53b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:42.458459 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-37934107-b8a9-434f-8da2-7f6f0f8ff53b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 6ebc061f-f94f-491b-ab41-a3182c046c61] Going to try to terminate instance {{(pid=133014) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 13:48:42.850048 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-37934107-b8a9-434f-8da2-7f6f0f8ff53b tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61" status: 204 len: 0 microversion: 2.1 time: 0.434143 Aug 24 13:48:42.850645 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 518/1052] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:48:42 2022] DELETE /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:48:42.859748 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-1b04af36-2f81-45ce-8081-416bbf65e188 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:42.860505 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-1b04af36-2f81-45ce-8081-416bbf65e188 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 6ebc061f-f94f-491b-ab41-a3182c046c61] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:42.867259 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1b04af36-2f81-45ce-8081-416bbf65e188 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:42.867747 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1b04af36-2f81-45ce-8081-416bbf65e188 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:42.868195 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1b04af36-2f81-45ce-8081-416bbf65e188 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:42.868985 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1b04af36-2f81-45ce-8081-416bbf65e188 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:42.869362 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1b04af36-2f81-45ce-8081-416bbf65e188 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:42.869787 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1b04af36-2f81-45ce-8081-416bbf65e188 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:43.006407 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-1b04af36-2f81-45ce-8081-416bbf65e188 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:43.014547 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-1b04af36-2f81-45ce-8081-416bbf65e188 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61" status: 200 len: 1513 microversion: 2.1 time: 0.159406 Aug 24 13:48:43.019398 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 535/1053] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:42 2022] GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:44.038542 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-5f2b85d3-3486-464a-b5a0-a14da5ec1e6f tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:44.039248 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-5f2b85d3-3486-464a-b5a0-a14da5ec1e6f tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 6ebc061f-f94f-491b-ab41-a3182c046c61] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:44.045842 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5f2b85d3-3486-464a-b5a0-a14da5ec1e6f tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:44.046328 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5f2b85d3-3486-464a-b5a0-a14da5ec1e6f tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:44.046765 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5f2b85d3-3486-464a-b5a0-a14da5ec1e6f tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:44.047462 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5f2b85d3-3486-464a-b5a0-a14da5ec1e6f tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:44.047921 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5f2b85d3-3486-464a-b5a0-a14da5ec1e6f tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:44.048501 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5f2b85d3-3486-464a-b5a0-a14da5ec1e6f tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:44.187977 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-5f2b85d3-3486-464a-b5a0-a14da5ec1e6f tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:44.196703 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-5f2b85d3-3486-464a-b5a0-a14da5ec1e6f tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61" status: 200 len: 1513 microversion: 2.1 time: 0.163573 Aug 24 13:48:44.197270 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 519/1054] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:44 2022] GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:45.218885 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-53b43b71-8aed-40f3-b35c-62c0e211a208 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:45.219484 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-53b43b71-8aed-40f3-b35c-62c0e211a208 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 6ebc061f-f94f-491b-ab41-a3182c046c61] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:45.227187 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-53b43b71-8aed-40f3-b35c-62c0e211a208 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:45.227676 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-53b43b71-8aed-40f3-b35c-62c0e211a208 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:45.228117 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-53b43b71-8aed-40f3-b35c-62c0e211a208 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:45.228845 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-53b43b71-8aed-40f3-b35c-62c0e211a208 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:45.229297 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-53b43b71-8aed-40f3-b35c-62c0e211a208 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:45.229718 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-53b43b71-8aed-40f3-b35c-62c0e211a208 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:45.370619 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-53b43b71-8aed-40f3-b35c-62c0e211a208 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:45.379074 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-53b43b71-8aed-40f3-b35c-62c0e211a208 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61" status: 200 len: 1513 microversion: 2.1 time: 0.164012 Aug 24 13:48:45.380977 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 536/1055] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:45 2022] GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:45.850559 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-4857eb00-e4dd-4995-a65c-8d15b6ae9da8 req-bc4faf59-4ec6-491a-9b8c-9109d2c4f4cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ebc061f-f94f-491b-ab41-a3182c046c61", "name": "network-vif-deleted", "tag": "e8bc6f55-990a-4e53-96e4-3a5c045be05c"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:48:45.861062 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-4857eb00-e4dd-4995-a65c-8d15b6ae9da8 req-bc4faf59-4ec6-491a-9b8c-9109d2c4f4cd service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:45.861545 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-4857eb00-e4dd-4995-a65c-8d15b6ae9da8 req-bc4faf59-4ec6-491a-9b8c-9109d2c4f4cd service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:45.861979 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-4857eb00-e4dd-4995-a65c-8d15b6ae9da8 req-bc4faf59-4ec6-491a-9b8c-9109d2c4f4cd service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:45.873711 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-4857eb00-e4dd-4995-a65c-8d15b6ae9da8 req-bc4faf59-4ec6-491a-9b8c-9109d2c4f4cd service nova] Creating event network-vif-deleted:e8bc6f55-990a-4e53-96e4-3a5c045be05c for instance 6ebc061f-f94f-491b-ab41-a3182c046c61 on hv-cinder-77957 Aug 24 13:48:45.878548 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-4857eb00-e4dd-4995-a65c-8d15b6ae9da8 req-bc4faf59-4ec6-491a-9b8c-9109d2c4f4cd service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032199 Aug 24 13:48:45.879210 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 520/1056] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:48:46.401372 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-458c9b72-7f46-438e-b685-82d3c8ea92e4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:46.401968 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-458c9b72-7f46-438e-b685-82d3c8ea92e4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 6ebc061f-f94f-491b-ab41-a3182c046c61] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:46.408444 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-458c9b72-7f46-438e-b685-82d3c8ea92e4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:46.408928 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-458c9b72-7f46-438e-b685-82d3c8ea92e4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:46.409358 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-458c9b72-7f46-438e-b685-82d3c8ea92e4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:46.410047 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-458c9b72-7f46-438e-b685-82d3c8ea92e4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:46.411217 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-458c9b72-7f46-438e-b685-82d3c8ea92e4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:46.411645 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-458c9b72-7f46-438e-b685-82d3c8ea92e4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:46.451626 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-458c9b72-7f46-438e-b685-82d3c8ea92e4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:46.452104 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-458c9b72-7f46-438e-b685-82d3c8ea92e4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:46.452570 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-458c9b72-7f46-438e-b685-82d3c8ea92e4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:46.453056 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.objects.instance [None req-458c9b72-7f46-438e-b685-82d3c8ea92e4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lazy-loading 'fault' on Instance uuid 6ebc061f-f94f-491b-ab41-a3182c046c61 {{(pid=133015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:48:46.495541 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-458c9b72-7f46-438e-b685-82d3c8ea92e4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:46.503166 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-458c9b72-7f46-438e-b685-82d3c8ea92e4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61" status: 200 len: 1309 microversion: 2.1 time: 0.105799 Aug 24 13:48:46.503732 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 537/1057] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:46 2022] GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:47.525691 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-2b095bc9-fe60-4d23-bbc0-2890f94afe8d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:47.526397 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-2b095bc9-fe60-4d23-bbc0-2890f94afe8d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 6ebc061f-f94f-491b-ab41-a3182c046c61] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:47.532634 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2b095bc9-fe60-4d23-bbc0-2890f94afe8d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:47.533138 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2b095bc9-fe60-4d23-bbc0-2890f94afe8d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:47.533571 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2b095bc9-fe60-4d23-bbc0-2890f94afe8d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:47.534279 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2b095bc9-fe60-4d23-bbc0-2890f94afe8d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:47.534739 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2b095bc9-fe60-4d23-bbc0-2890f94afe8d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:47.535168 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2b095bc9-fe60-4d23-bbc0-2890f94afe8d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:47.549627 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-2b095bc9-fe60-4d23-bbc0-2890f94afe8d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] HTTP exception thrown: Instance 6ebc061f-f94f-491b-ab41-a3182c046c61 could not be found. Aug 24 13:48:47.552018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-2b095bc9-fe60-4d23-bbc0-2890f94afe8d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Request method failure captured: Aug 24 13:48:47.552018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61 HTTP/1.1 Aug 24 13:48:47.552018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:48:47.552018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:48:47.552018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:48:47.552018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:48:47.552018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:48:47.552018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:48:47.552018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:48:47.552018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:48:47.552018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBiv2pOg-prB4ejJ32KKGxmLOWxXUGO4iJERVjN9_y1oI7IU6xGJzEODSkYfCVrUYUA0JiGFuXfEyFmApz4BaXYXAKiy_VA-tXBG7z0FIQ5Un5dibI0DspN2K2CcqYya2Cn6KAPDo2DFSUn7t_m0XvFLRLkv261pUYEXkko1SCbTvQPE Aug 24 13:48:47.552018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:48:47.552018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:48:47.552018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:48:47.552018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:48:47.552018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:48:47.552018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:48:47.552018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 1a7c5f7e89a74cab86be21c2bb4819ab Aug 24 13:48:47.552018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1338797284 Aug 24 13:48:47.552018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:48:47.552018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:48:47.553717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1a7c5f7e89a74cab86be21c2bb4819ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1a7c5f7e89a74cab86be21c2bb4819ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1a7c5f7e89a74cab86be21c2bb4819ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1a7c5f7e89a74cab86be21c2bb4819ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:48:47.553717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-VolumesSnapshotTestJSON-1338797284 Aug 24 13:48:47.553717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 1a7c5f7e89a74cab86be21c2bb4819ab Aug 24 13:48:47.553717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1338797284 Aug 24 13:48:47.553717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-VolumesSnapshotTestJSON-1338797284-project Aug 24 13:48:47.553717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:48:47.553717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:48:47.553717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: e9ee68b458234fe482b5c2e777b71967 Aug 24 13:48:47.553717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-VolumesSnapshotTestJSON-1338797284-project Aug 24 13:48:47.553717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:48:47.553717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Instance 6ebc061f-f94f-491b-ab41-a3182c046c61 could not be found. Aug 24 13:48:47.553717 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': '6ebc061f-f94f-491b-ab41-a3182c046c61'} Aug 24 13:48:47.554720 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:48:47.554720 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:48:47.554720 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:48:47.554720 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:48:47.554720 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:48:47.554720 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:48:47.554720 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:48:47.554720 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:48:47.554720 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:48:47.554720 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:48:47.554720 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ebc061f-f94f-491b-ab41-a3182c046c61 could not be found. Aug 24 13:48:47.554720 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:48:47.554720 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:48:47.554720 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:48:47.554720 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:48:47.554720 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:48:47.554720 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:48:47.554720 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:48:47.554720 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:48:47.554720 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:48:47.556285 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:48:47.556285 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:48:47.556285 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:48:47.556285 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:48:47.556285 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:48:47.556285 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:48:47.556285 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:48:47.556285 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ebc061f-f94f-491b-ab41-a3182c046c61 could not be found. Aug 24 13:48:47.556285 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:48:47.556285 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:48:47.556285 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:48:47.556285 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:48:47.556285 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:48:47.556285 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:48:47.556285 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:48:47.556285 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:48:47.556285 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ebc061f-f94f-491b-ab41-a3182c046c61 could not be found. Aug 24 13:48:47.556285 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:48:47.558207 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-2b095bc9-fe60-4d23-bbc0-2890f94afe8d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Returning 404 to user: Instance 6ebc061f-f94f-491b-ab41-a3182c046c61 could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:48:47.558207 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-2b095bc9-fe60-4d23-bbc0-2890f94afe8d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61" status: 404 len: 111 microversion: 2.1 time: 0.032543 Aug 24 13:48:47.558207 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 521/1058] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:47 2022] GET /compute/v2.1/servers/6ebc061f-f94f-491b-ab41-a3182c046c61 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:48:57.351352 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-47624283-1fe2-4e15-92d2-1496a7a057d8 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:57.351918 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-47624283-1fe2-4e15-92d2-1496a7a057d8 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:57.353921 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_api:SELECT=10 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:48:57.354572 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:48:57.359149 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-47624283-1fe2-4e15-92d2-1496a7a057d8 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:57.359637 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-47624283-1fe2-4e15-92d2-1496a7a057d8 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:57.360068 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-47624283-1fe2-4e15-92d2-1496a7a057d8 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:57.360868 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-47624283-1fe2-4e15-92d2-1496a7a057d8 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:57.368191 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-47624283-1fe2-4e15-92d2-1496a7a057d8 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:57.368191 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-47624283-1fe2-4e15-92d2-1496a7a057d8 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:57.444492 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.objects.instance [None req-47624283-1fe2-4e15-92d2-1496a7a057d8 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lazy-loading 'services' on Instance uuid 31b97d61-96c0-459d-83c5-ebd1929f344a {{(pid=133015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:48:57.762959 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-47624283-1fe2-4e15-92d2-1496a7a057d8 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "DELETE /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a/os-volume_attachments/41d197d3-5842-4a91-b533-b9984cf4984e" status: 202 len: 0 microversion: 2.1 time: 0.416063 Aug 24 13:48:57.763621 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 538/1059] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 13:48:57 2022] DELETE /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a/os-volume_attachments/41d197d3-5842-4a91-b533-b9984cf4984e => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:48:58.152395 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-cf6500ef-b9aa-4532-b17c-cde856975753 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1283365494", "imageRef": "c520113c-3dae-4490-98bb-19fe3a46b66d", "flavorRef": "452", "networks": [{"uuid": "aba50ab5-0afd-4b22-a05b-b99018130d42"}]}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:48:58.161772 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:48:58.162448 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:48:58.212110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.network.neutron [None req-cf6500ef-b9aa-4532-b17c-cde856975753 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] validate_networks() for [('aba50ab5-0afd-4b22-a05b-b99018130d42', None, None, None, None, None)] {{(pid=133014) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:48:58.575970 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-cf6500ef-b9aa-4532-b17c-cde856975753 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Flavor limits 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:48:58.576430 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-cf6500ef-b9aa-4532-b17c-cde856975753 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Image limits 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:48:58.576982 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-cf6500ef-b9aa-4532-b17c-cde856975753 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Flavor pref 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:48:58.577413 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-cf6500ef-b9aa-4532-b17c-cde856975753 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Image pref 0:0:0 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:48:58.577978 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.virt.hardware [None req-cf6500ef-b9aa-4532-b17c-cde856975753 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:48:58.587114 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cf6500ef-b9aa-4532-b17c-cde856975753 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:58.588732 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cf6500ef-b9aa-4532-b17c-cde856975753 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:58.588732 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cf6500ef-b9aa-4532-b17c-cde856975753 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:58.588732 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cf6500ef-b9aa-4532-b17c-cde856975753 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:58.589354 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cf6500ef-b9aa-4532-b17c-cde856975753 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:58.589772 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cf6500ef-b9aa-4532-b17c-cde856975753 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:58.606912 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-cf6500ef-b9aa-4532-b17c-cde856975753 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Getting quotas for project 1a7c5f7e89a74cab86be21c2bb4819ab. Resources: {'instances', 'cores', 'ram'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:48:58.611082 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.quota [None req-cf6500ef-b9aa-4532-b17c-cde856975753 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Getting quotas for user e9ee68b458234fe482b5c2e777b71967 and project 1a7c5f7e89a74cab86be21c2bb4819ab. Resources: {'instances', 'cores', 'ram'} {{(pid=133014) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:48:58.623557 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-cf6500ef-b9aa-4532-b17c-cde856975753 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Going to run 1 instances... {{(pid=133014) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 13:48:58.625901 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-cf6500ef-b9aa-4532-b17c-cde856975753 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 5948628b-139a-443c-a9ad-26eaf45599d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c520113c-3dae-4490-98bb-19fe3a46b66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133014) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 13:48:58.742746 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-cf6500ef-b9aa-4532-b17c-cde856975753 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594248 Aug 24 13:48:58.743871 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 522/1060] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 13:48:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 13:48:58.756122 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-436bf824-8950-4d71-98b3-34828852ab20 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:58.756797 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-436bf824-8950-4d71-98b3-34828852ab20 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 5948628b-139a-443c-a9ad-26eaf45599d8] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:58.812965 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-436bf824-8950-4d71-98b3-34828852ab20 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:58.820719 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-436bf824-8950-4d71-98b3-34828852ab20 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8" status: 200 len: 1219 microversion: 2.1 time: 0.069405 Aug 24 13:48:58.821256 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 539/1061] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:58 2022] GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:59.842880 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-cba76d81-5c45-4fd6-bc68-c77d75e3627d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:48:59.843483 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-cba76d81-5c45-4fd6-bc68-c77d75e3627d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 5948628b-139a-443c-a9ad-26eaf45599d8] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:48:59.851159 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cba76d81-5c45-4fd6-bc68-c77d75e3627d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:59.851650 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cba76d81-5c45-4fd6-bc68-c77d75e3627d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:59.852119 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cba76d81-5c45-4fd6-bc68-c77d75e3627d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:59.852858 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cba76d81-5c45-4fd6-bc68-c77d75e3627d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:59.853316 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cba76d81-5c45-4fd6-bc68-c77d75e3627d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:59.853747 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cba76d81-5c45-4fd6-bc68-c77d75e3627d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:59.921618 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-cba76d81-5c45-4fd6-bc68-c77d75e3627d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:48:59.931890 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-cba76d81-5c45-4fd6-bc68-c77d75e3627d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8" status: 200 len: 1223 microversion: 2.1 time: 0.093024 Aug 24 13:48:59.933494 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 523/1062] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:48:59 2022] GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8 => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:48:59.964059 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-4e6dbbf9-d79d-4c3f-8073-9191eac87de1 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:48:59.972066 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4e6dbbf9-d79d-4c3f-8073-9191eac87de1 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:48:59.972622 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4e6dbbf9-d79d-4c3f-8073-9191eac87de1 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:48:59.973151 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4e6dbbf9-d79d-4c3f-8073-9191eac87de1 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:48:59.996638 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-4e6dbbf9-d79d-4c3f-8073-9191eac87de1 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Going to try to stop instance {{(pid=133015) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 13:49:00.286722 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-4e6dbbf9-d79d-4c3f-8073-9191eac87de1 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "POST /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a/action" status: 202 len: 0 microversion: 2.1 time: 0.326431 Aug 24 13:49:00.287348 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 540/1063] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 13:48:59 2022] POST /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:49:00.295808 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-122f0961-a96f-418e-9ec6-989ec0f14d78 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:00.296737 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-122f0961-a96f-418e-9ec6-989ec0f14d78 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:00.303307 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-122f0961-a96f-418e-9ec6-989ec0f14d78 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:00.303800 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-122f0961-a96f-418e-9ec6-989ec0f14d78 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:00.304268 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-122f0961-a96f-418e-9ec6-989ec0f14d78 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:00.304978 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-122f0961-a96f-418e-9ec6-989ec0f14d78 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:00.305432 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-122f0961-a96f-418e-9ec6-989ec0f14d78 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:00.305878 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-122f0961-a96f-418e-9ec6-989ec0f14d78 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:00.444026 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-122f0961-a96f-418e-9ec6-989ec0f14d78 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:00.451759 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-122f0961-a96f-418e-9ec6-989ec0f14d78 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1675 microversion: 2.1 time: 0.159950 Aug 24 13:49:00.452367 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 524/1064] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:00 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:00.954033 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-96817390-459a-47eb-b255-96a106af7747 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:00.954866 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-96817390-459a-47eb-b255-96a106af7747 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 5948628b-139a-443c-a9ad-26eaf45599d8] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:00.962010 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-96817390-459a-47eb-b255-96a106af7747 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:00.962505 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-96817390-459a-47eb-b255-96a106af7747 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:00.962949 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-96817390-459a-47eb-b255-96a106af7747 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:00.963647 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-96817390-459a-47eb-b255-96a106af7747 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:00.964803 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-96817390-459a-47eb-b255-96a106af7747 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:00.965368 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-96817390-459a-47eb-b255-96a106af7747 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:01.033291 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-96817390-459a-47eb-b255-96a106af7747 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:01.041803 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-96817390-459a-47eb-b255-96a106af7747 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8" status: 200 len: 1279 microversion: 2.1 time: 0.092042 Aug 24 13:49:01.042391 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 541/1065] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:00 2022] GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8 => generated 1279 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:01.473169 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-3c40c09a-8cfb-441c-8b00-a94adfce828d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:01.473888 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-3c40c09a-8cfb-441c-8b00-a94adfce828d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:01.480583 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3c40c09a-8cfb-441c-8b00-a94adfce828d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:01.481148 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3c40c09a-8cfb-441c-8b00-a94adfce828d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:01.481653 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3c40c09a-8cfb-441c-8b00-a94adfce828d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:01.482422 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3c40c09a-8cfb-441c-8b00-a94adfce828d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:01.482974 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3c40c09a-8cfb-441c-8b00-a94adfce828d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:01.483473 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3c40c09a-8cfb-441c-8b00-a94adfce828d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:01.632532 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3c40c09a-8cfb-441c-8b00-a94adfce828d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:01.640433 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-3c40c09a-8cfb-441c-8b00-a94adfce828d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1675 microversion: 2.1 time: 0.171087 Aug 24 13:49:01.641004 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 525/1066] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:01 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:02.065038 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-aff219ff-c8db-418c-8960-219120346828 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:02.065038 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-aff219ff-c8db-418c-8960-219120346828 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 5948628b-139a-443c-a9ad-26eaf45599d8] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:02.070805 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aff219ff-c8db-418c-8960-219120346828 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:02.071301 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aff219ff-c8db-418c-8960-219120346828 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:02.071732 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aff219ff-c8db-418c-8960-219120346828 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:02.072467 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aff219ff-c8db-418c-8960-219120346828 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:02.072918 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aff219ff-c8db-418c-8960-219120346828 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:02.073340 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aff219ff-c8db-418c-8960-219120346828 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:02.209958 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-aff219ff-c8db-418c-8960-219120346828 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:02.221342 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-aff219ff-c8db-418c-8960-219120346828 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8" status: 200 len: 1319 microversion: 2.1 time: 0.161861 Aug 24 13:49:02.222408 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 542/1067] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:02 2022] GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:02.667234 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-cee654fd-094c-49ac-a59e-62d092963481 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:02.667836 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-cee654fd-094c-49ac-a59e-62d092963481 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:02.678066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cee654fd-094c-49ac-a59e-62d092963481 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:02.678631 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cee654fd-094c-49ac-a59e-62d092963481 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:02.679176 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cee654fd-094c-49ac-a59e-62d092963481 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:02.679970 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cee654fd-094c-49ac-a59e-62d092963481 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:02.682615 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cee654fd-094c-49ac-a59e-62d092963481 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:02.683067 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cee654fd-094c-49ac-a59e-62d092963481 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:02.873185 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-cee654fd-094c-49ac-a59e-62d092963481 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:02.883829 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-cee654fd-094c-49ac-a59e-62d092963481 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1675 microversion: 2.1 time: 0.223923 Aug 24 13:49:02.884439 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 526/1068] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:02 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1675 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:02.970203 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-9eda8986-ce5a-426d-8bcc-b1388a6880e6 req-fe828e63-cfb3-47d2-b902-22350dd7a568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5948628b-139a-443c-a9ad-26eaf45599d8", "tag": "2cafb065-bf32-49fa-b7f7-fbb889ee1127"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:49:02.984385 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-9eda8986-ce5a-426d-8bcc-b1388a6880e6 req-fe828e63-cfb3-47d2-b902-22350dd7a568 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:02.984862 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-9eda8986-ce5a-426d-8bcc-b1388a6880e6 req-fe828e63-cfb3-47d2-b902-22350dd7a568 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:02.985300 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-9eda8986-ce5a-426d-8bcc-b1388a6880e6 req-fe828e63-cfb3-47d2-b902-22350dd7a568 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:03.004433 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-9eda8986-ce5a-426d-8bcc-b1388a6880e6 req-fe828e63-cfb3-47d2-b902-22350dd7a568 service nova] Creating event network-changed:2cafb065-bf32-49fa-b7f7-fbb889ee1127 for instance 5948628b-139a-443c-a9ad-26eaf45599d8 on hv-cinder-77957 Aug 24 13:49:03.005537 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-9eda8986-ce5a-426d-8bcc-b1388a6880e6 req-fe828e63-cfb3-47d2-b902-22350dd7a568 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038743 Aug 24 13:49:03.006691 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 543/1069] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:49:03.245653 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-83acd666-5b49-4f0f-a430-21a0da39b977 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:03.246601 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-83acd666-5b49-4f0f-a430-21a0da39b977 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 5948628b-139a-443c-a9ad-26eaf45599d8] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:03.254283 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-83acd666-5b49-4f0f-a430-21a0da39b977 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:03.255890 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-83acd666-5b49-4f0f-a430-21a0da39b977 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:03.256456 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-83acd666-5b49-4f0f-a430-21a0da39b977 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:03.257359 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-83acd666-5b49-4f0f-a430-21a0da39b977 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:03.258713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-83acd666-5b49-4f0f-a430-21a0da39b977 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:03.258713 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-83acd666-5b49-4f0f-a430-21a0da39b977 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:03.402170 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-83acd666-5b49-4f0f-a430-21a0da39b977 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:03.409935 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-83acd666-5b49-4f0f-a430-21a0da39b977 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8" status: 200 len: 1319 microversion: 2.1 time: 0.169085 Aug 24 13:49:03.410498 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 527/1070] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:03 2022] GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:03.908398 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-aa7b1b1f-96bb-4278-80e0-bde58aa5c15a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:03.909099 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-aa7b1b1f-96bb-4278-80e0-bde58aa5c15a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:03.916721 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aa7b1b1f-96bb-4278-80e0-bde58aa5c15a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:03.917201 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aa7b1b1f-96bb-4278-80e0-bde58aa5c15a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:03.917638 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aa7b1b1f-96bb-4278-80e0-bde58aa5c15a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:03.918328 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aa7b1b1f-96bb-4278-80e0-bde58aa5c15a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:03.918779 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aa7b1b1f-96bb-4278-80e0-bde58aa5c15a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:03.919203 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-aa7b1b1f-96bb-4278-80e0-bde58aa5c15a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:04.062458 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-aa7b1b1f-96bb-4278-80e0-bde58aa5c15a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:04.071717 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-aa7b1b1f-96bb-4278-80e0-bde58aa5c15a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1675 microversion: 2.1 time: 0.167572 Aug 24 13:49:04.072337 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 544/1071] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:03 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:04.430856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-fce73088-0651-47b7-9205-36d4ce76b3bb tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:04.431472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-fce73088-0651-47b7-9205-36d4ce76b3bb tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 5948628b-139a-443c-a9ad-26eaf45599d8] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:04.438828 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fce73088-0651-47b7-9205-36d4ce76b3bb tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:04.439316 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fce73088-0651-47b7-9205-36d4ce76b3bb tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:04.439750 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fce73088-0651-47b7-9205-36d4ce76b3bb tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:04.440504 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fce73088-0651-47b7-9205-36d4ce76b3bb tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:04.440959 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fce73088-0651-47b7-9205-36d4ce76b3bb tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:04.441384 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fce73088-0651-47b7-9205-36d4ce76b3bb tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:04.576290 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-fce73088-0651-47b7-9205-36d4ce76b3bb tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:04.584855 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-fce73088-0651-47b7-9205-36d4ce76b3bb tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8" status: 200 len: 1319 microversion: 2.1 time: 0.157948 Aug 24 13:49:04.585426 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 528/1072] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:04 2022] GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:05.093547 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-7efb3c54-c244-469e-b201-c1df4a0f1749 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:05.094163 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-7efb3c54-c244-469e-b201-c1df4a0f1749 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:05.101125 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7efb3c54-c244-469e-b201-c1df4a0f1749 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:05.101611 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7efb3c54-c244-469e-b201-c1df4a0f1749 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:05.102046 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7efb3c54-c244-469e-b201-c1df4a0f1749 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:05.102737 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7efb3c54-c244-469e-b201-c1df4a0f1749 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:05.103196 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7efb3c54-c244-469e-b201-c1df4a0f1749 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:05.103619 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-7efb3c54-c244-469e-b201-c1df4a0f1749 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:05.234274 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-7efb3c54-c244-469e-b201-c1df4a0f1749 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:05.242765 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-7efb3c54-c244-469e-b201-c1df4a0f1749 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1675 microversion: 2.1 time: 0.153157 Aug 24 13:49:05.243332 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 545/1073] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:05 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:05.605351 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-3eb31038-7f68-4ef0-80ec-e05f17062eb4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:05.613154 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-3eb31038-7f68-4ef0-80ec-e05f17062eb4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 5948628b-139a-443c-a9ad-26eaf45599d8] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:05.613154 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3eb31038-7f68-4ef0-80ec-e05f17062eb4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:05.613154 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3eb31038-7f68-4ef0-80ec-e05f17062eb4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:05.613154 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3eb31038-7f68-4ef0-80ec-e05f17062eb4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:05.613740 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3eb31038-7f68-4ef0-80ec-e05f17062eb4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:05.614911 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3eb31038-7f68-4ef0-80ec-e05f17062eb4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:05.615333 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3eb31038-7f68-4ef0-80ec-e05f17062eb4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:05.758746 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-3eb31038-7f68-4ef0-80ec-e05f17062eb4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:05.766451 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-3eb31038-7f68-4ef0-80ec-e05f17062eb4 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8" status: 200 len: 1319 microversion: 2.1 time: 0.165009 Aug 24 13:49:05.767071 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 529/1074] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:05 2022] GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:06.263439 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-9aa61488-9d72-49d3-8f29-86cfe0456845 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:06.263962 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-9aa61488-9d72-49d3-8f29-86cfe0456845 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:06.270651 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9aa61488-9d72-49d3-8f29-86cfe0456845 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:06.271145 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9aa61488-9d72-49d3-8f29-86cfe0456845 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:06.271586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9aa61488-9d72-49d3-8f29-86cfe0456845 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:06.272987 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9aa61488-9d72-49d3-8f29-86cfe0456845 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:06.273453 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9aa61488-9d72-49d3-8f29-86cfe0456845 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:06.273880 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9aa61488-9d72-49d3-8f29-86cfe0456845 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:06.405845 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-9aa61488-9d72-49d3-8f29-86cfe0456845 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:06.415132 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-9aa61488-9d72-49d3-8f29-86cfe0456845 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1675 microversion: 2.1 time: 0.155580 Aug 24 13:49:06.415720 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 546/1075] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:06 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:06.789293 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-0ccfd29c-d8cb-45b2-b6f4-e628e5249ebb tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:06.789902 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-0ccfd29c-d8cb-45b2-b6f4-e628e5249ebb tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 5948628b-139a-443c-a9ad-26eaf45599d8] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:06.796731 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0ccfd29c-d8cb-45b2-b6f4-e628e5249ebb tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:06.797174 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0ccfd29c-d8cb-45b2-b6f4-e628e5249ebb tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:06.797570 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0ccfd29c-d8cb-45b2-b6f4-e628e5249ebb tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:06.798283 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0ccfd29c-d8cb-45b2-b6f4-e628e5249ebb tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:06.798740 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0ccfd29c-d8cb-45b2-b6f4-e628e5249ebb tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:06.799170 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-0ccfd29c-d8cb-45b2-b6f4-e628e5249ebb tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:06.939826 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0ccfd29c-d8cb-45b2-b6f4-e628e5249ebb tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:06.948574 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-0ccfd29c-d8cb-45b2-b6f4-e628e5249ebb tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8" status: 200 len: 1319 microversion: 2.1 time: 0.163843 Aug 24 13:49:06.949195 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 530/1076] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:06 2022] GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:07.437872 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-10759caa-f65a-407a-aad4-12e7dd926cb8 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:07.438474 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-10759caa-f65a-407a-aad4-12e7dd926cb8 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:07.446603 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-10759caa-f65a-407a-aad4-12e7dd926cb8 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:07.447125 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-10759caa-f65a-407a-aad4-12e7dd926cb8 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:07.447563 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-10759caa-f65a-407a-aad4-12e7dd926cb8 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:07.448302 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-10759caa-f65a-407a-aad4-12e7dd926cb8 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:07.448759 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-10759caa-f65a-407a-aad4-12e7dd926cb8 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:07.449180 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-10759caa-f65a-407a-aad4-12e7dd926cb8 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:07.602852 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-10759caa-f65a-407a-aad4-12e7dd926cb8 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:07.612828 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-10759caa-f65a-407a-aad4-12e7dd926cb8 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1675 microversion: 2.1 time: 0.178829 Aug 24 13:49:07.613517 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 547/1077] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:07 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1675 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:07.969293 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-2b99d75f-95d7-4d0e-a77c-f094bbda7aa5 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:07.969845 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-2b99d75f-95d7-4d0e-a77c-f094bbda7aa5 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 5948628b-139a-443c-a9ad-26eaf45599d8] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:07.977192 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2b99d75f-95d7-4d0e-a77c-f094bbda7aa5 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:07.977686 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2b99d75f-95d7-4d0e-a77c-f094bbda7aa5 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:07.978157 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2b99d75f-95d7-4d0e-a77c-f094bbda7aa5 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:07.978861 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2b99d75f-95d7-4d0e-a77c-f094bbda7aa5 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:07.979322 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2b99d75f-95d7-4d0e-a77c-f094bbda7aa5 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:07.979746 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-2b99d75f-95d7-4d0e-a77c-f094bbda7aa5 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:08.125296 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-2b99d75f-95d7-4d0e-a77c-f094bbda7aa5 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:08.133705 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-2b99d75f-95d7-4d0e-a77c-f094bbda7aa5 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8" status: 200 len: 1319 microversion: 2.1 time: 0.168299 Aug 24 13:49:08.134295 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 531/1078] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:07 2022] GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:08.644130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-ea362162-d626-473e-acd7-faf5d68ece09 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:08.644760 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-ea362162-d626-473e-acd7-faf5d68ece09 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:08.652285 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ea362162-d626-473e-acd7-faf5d68ece09 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:08.652764 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ea362162-d626-473e-acd7-faf5d68ece09 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:08.653432 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ea362162-d626-473e-acd7-faf5d68ece09 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:08.654118 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ea362162-d626-473e-acd7-faf5d68ece09 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:08.654566 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ea362162-d626-473e-acd7-faf5d68ece09 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:08.654984 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ea362162-d626-473e-acd7-faf5d68ece09 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:08.792917 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-ea362162-d626-473e-acd7-faf5d68ece09 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:08.801061 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-ea362162-d626-473e-acd7-faf5d68ece09 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1675 microversion: 2.1 time: 0.160753 Aug 24 13:49:08.805927 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 548/1079] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:08 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:08.953392 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a1d74f20-a4fc-4e69-bb49-d49fa85c04ad tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-175118086"}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:49:08.953846 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a1d74f20-a4fc-4e69-bb49-d49fa85c04ad tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:08.955687 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=2 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:49:08.956378 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=6 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:49:08.961738 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a1d74f20-a4fc-4e69-bb49-d49fa85c04ad tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:08.966955 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a1d74f20-a4fc-4e69-bb49-d49fa85c04ad tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:08.966955 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a1d74f20-a4fc-4e69-bb49-d49fa85c04ad tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:08.966955 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a1d74f20-a4fc-4e69-bb49-d49fa85c04ad tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:08.966955 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a1d74f20-a4fc-4e69-bb49-d49fa85c04ad tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:08.967353 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a1d74f20-a4fc-4e69-bb49-d49fa85c04ad tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:09.155107 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-f3c7efe3-78e9-4fa2-a5e9-4b0b65f794c2 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:09.155791 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-f3c7efe3-78e9-4fa2-a5e9-4b0b65f794c2 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 5948628b-139a-443c-a9ad-26eaf45599d8] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:09.157786 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=2 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:49:09.163187 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f3c7efe3-78e9-4fa2-a5e9-4b0b65f794c2 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:09.163737 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f3c7efe3-78e9-4fa2-a5e9-4b0b65f794c2 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:09.164169 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f3c7efe3-78e9-4fa2-a5e9-4b0b65f794c2 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:09.165041 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f3c7efe3-78e9-4fa2-a5e9-4b0b65f794c2 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:09.166099 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f3c7efe3-78e9-4fa2-a5e9-4b0b65f794c2 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:09.166962 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f3c7efe3-78e9-4fa2-a5e9-4b0b65f794c2 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:09.276924 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.network.security_group_api [None req-a1d74f20-a4fc-4e69-bb49-d49fa85c04ad tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Removing security group 484d3c43-095b-4887-b41a-09657dd45981 from port 918b2634-4141-429d-95ff-f9bae50b39dc Aug 24 13:49:09.408393 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-f3c7efe3-78e9-4fa2-a5e9-4b0b65f794c2 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:09.416155 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-f3c7efe3-78e9-4fa2-a5e9-4b0b65f794c2 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8" status: 200 len: 1319 microversion: 2.1 time: 0.264981 Aug 24 13:49:09.416977 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 549/1080] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:09 2022] GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:49:09.712218 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-81564499-6580-4ca5-badd-643b1ada2c4c req-8591a3c0-8856-4906-8cef-6298cbe16068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5948628b-139a-443c-a9ad-26eaf45599d8", "name": "network-vif-plugged", "status": "completed", "tag": "2cafb065-bf32-49fa-b7f7-fbb889ee1127"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:49:09.725298 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-81564499-6580-4ca5-badd-643b1ada2c4c req-8591a3c0-8856-4906-8cef-6298cbe16068 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:09.725793 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-81564499-6580-4ca5-badd-643b1ada2c4c req-8591a3c0-8856-4906-8cef-6298cbe16068 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:09.726231 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-81564499-6580-4ca5-badd-643b1ada2c4c req-8591a3c0-8856-4906-8cef-6298cbe16068 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:09.739230 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-81564499-6580-4ca5-badd-643b1ada2c4c req-8591a3c0-8856-4906-8cef-6298cbe16068 service nova] Creating event network-vif-plugged:2cafb065-bf32-49fa-b7f7-fbb889ee1127 for instance 5948628b-139a-443c-a9ad-26eaf45599d8 on hv-cinder-77957 Aug 24 13:49:09.745890 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-81564499-6580-4ca5-badd-643b1ada2c4c req-8591a3c0-8856-4906-8cef-6298cbe16068 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038073 Aug 24 13:49:09.747764 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 550/1081] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:49:09.791313 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a1d74f20-a4fc-4e69-bb49-d49fa85c04ad tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "POST /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024/action" status: 202 len: 0 microversion: 2.1 time: 0.841852 Aug 24 13:49:09.791953 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 532/1082] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 13:49:08 2022] POST /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024/action => generated 0 bytes in 843 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:49:09.824276 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-98e0057f-ee90-4d30-9e9a-52da547e55ad tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:09.824906 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-98e0057f-ee90-4d30-9e9a-52da547e55ad tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:09.839141 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-98e0057f-ee90-4d30-9e9a-52da547e55ad tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:09.839652 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-98e0057f-ee90-4d30-9e9a-52da547e55ad tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:09.840101 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-98e0057f-ee90-4d30-9e9a-52da547e55ad tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:09.841481 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-98e0057f-ee90-4d30-9e9a-52da547e55ad tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:09.842000 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-98e0057f-ee90-4d30-9e9a-52da547e55ad tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:09.842424 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-98e0057f-ee90-4d30-9e9a-52da547e55ad tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:09.922775 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-c6fdad47-0c5e-4d7d-9055-895dc307a3f5 req-0e6b9197-99d7-432c-8a4e-9175d47a0e06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d1d1e2a-ddc9-4a66-8db4-6cccea722024", "tag": "918b2634-4141-429d-95ff-f9bae50b39dc"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:49:09.941205 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-c6fdad47-0c5e-4d7d-9055-895dc307a3f5 req-0e6b9197-99d7-432c-8a4e-9175d47a0e06 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:09.942021 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-c6fdad47-0c5e-4d7d-9055-895dc307a3f5 req-0e6b9197-99d7-432c-8a4e-9175d47a0e06 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:09.942525 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-c6fdad47-0c5e-4d7d-9055-895dc307a3f5 req-0e6b9197-99d7-432c-8a4e-9175d47a0e06 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:09.957884 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-c6fdad47-0c5e-4d7d-9055-895dc307a3f5 req-0e6b9197-99d7-432c-8a4e-9175d47a0e06 service nova] Creating event network-changed:918b2634-4141-429d-95ff-f9bae50b39dc for instance 5d1d1e2a-ddc9-4a66-8db4-6cccea722024 on hv-cinder-77957 Aug 24 13:49:09.965156 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-c6fdad47-0c5e-4d7d-9055-895dc307a3f5 req-0e6b9197-99d7-432c-8a4e-9175d47a0e06 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170136 Aug 24 13:49:09.967407 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 551/1083] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:49:10.066349 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-98e0057f-ee90-4d30-9e9a-52da547e55ad tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:10.075686 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-98e0057f-ee90-4d30-9e9a-52da547e55ad tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1675 microversion: 2.1 time: 0.255579 Aug 24 13:49:10.076496 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 533/1084] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:09 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1675 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:10.437992 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-ed5bfa04-f74b-4fe3-ae21-71ecadbf1590 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:10.438723 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-ed5bfa04-f74b-4fe3-ae21-71ecadbf1590 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 5948628b-139a-443c-a9ad-26eaf45599d8] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:10.447554 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ed5bfa04-f74b-4fe3-ae21-71ecadbf1590 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:10.448046 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ed5bfa04-f74b-4fe3-ae21-71ecadbf1590 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:10.448512 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ed5bfa04-f74b-4fe3-ae21-71ecadbf1590 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:10.449212 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ed5bfa04-f74b-4fe3-ae21-71ecadbf1590 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:10.449664 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ed5bfa04-f74b-4fe3-ae21-71ecadbf1590 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:10.450089 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ed5bfa04-f74b-4fe3-ae21-71ecadbf1590 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:10.662755 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-ed5bfa04-f74b-4fe3-ae21-71ecadbf1590 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:10.671013 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-ed5bfa04-f74b-4fe3-ae21-71ecadbf1590 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8" status: 200 len: 1319 microversion: 2.1 time: 0.237196 Aug 24 13:49:10.671667 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 552/1085] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:10 2022] GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:11.098506 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-368d1a64-1b68-42c2-a253-ab3c729dd71d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:11.099141 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-368d1a64-1b68-42c2-a253-ab3c729dd71d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:11.106772 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-368d1a64-1b68-42c2-a253-ab3c729dd71d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:11.107262 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-368d1a64-1b68-42c2-a253-ab3c729dd71d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:11.107746 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-368d1a64-1b68-42c2-a253-ab3c729dd71d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:11.108483 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-368d1a64-1b68-42c2-a253-ab3c729dd71d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:11.108966 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-368d1a64-1b68-42c2-a253-ab3c729dd71d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:11.109398 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-368d1a64-1b68-42c2-a253-ab3c729dd71d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:11.394860 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-368d1a64-1b68-42c2-a253-ab3c729dd71d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:11.403099 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-368d1a64-1b68-42c2-a253-ab3c729dd71d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1675 microversion: 2.1 time: 0.308499 Aug 24 13:49:11.409326 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 534/1086] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:11 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1675 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:11.585517 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-1f9f073d-10d3-4e8a-85e7-849e566025e2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:11.586266 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-1f9f073d-10d3-4e8a-85e7-849e566025e2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:11.592962 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1f9f073d-10d3-4e8a-85e7-849e566025e2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:11.593835 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1f9f073d-10d3-4e8a-85e7-849e566025e2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:11.593972 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1f9f073d-10d3-4e8a-85e7-849e566025e2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:11.594589 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1f9f073d-10d3-4e8a-85e7-849e566025e2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:11.595117 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1f9f073d-10d3-4e8a-85e7-849e566025e2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:11.595544 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1f9f073d-10d3-4e8a-85e7-849e566025e2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:11.692876 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-d84dd8b5-8098-4797-a48b-1d76e60a4b3e tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:11.693652 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-d84dd8b5-8098-4797-a48b-1d76e60a4b3e tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 5948628b-139a-443c-a9ad-26eaf45599d8] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:11.694757 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.objects.instance [None req-1f9f073d-10d3-4e8a-85e7-849e566025e2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lazy-loading 'services' on Instance uuid 5d1d1e2a-ddc9-4a66-8db4-6cccea722024 {{(pid=133015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:49:11.700155 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d84dd8b5-8098-4797-a48b-1d76e60a4b3e tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:11.700677 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d84dd8b5-8098-4797-a48b-1d76e60a4b3e tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:11.701311 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d84dd8b5-8098-4797-a48b-1d76e60a4b3e tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:11.702071 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d84dd8b5-8098-4797-a48b-1d76e60a4b3e tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:11.702471 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d84dd8b5-8098-4797-a48b-1d76e60a4b3e tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:11.702892 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d84dd8b5-8098-4797-a48b-1d76e60a4b3e tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:11.858697 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-d84dd8b5-8098-4797-a48b-1d76e60a4b3e tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:11.872970 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-d84dd8b5-8098-4797-a48b-1d76e60a4b3e tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8" status: 200 len: 1319 microversion: 2.1 time: 0.184285 Aug 24 13:49:11.874360 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 535/1087] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:11 2022] GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:49:11.964658 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-1f9f073d-10d3-4e8a-85e7-849e566025e2 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024/os-volume_attachments/4557bf98-ba90-429e-92fb-02fbc229b672" status: 202 len: 0 microversion: 2.1 time: 0.383270 Aug 24 13:49:11.965255 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 553/1088] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 13:49:11 2022] DELETE /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024/os-volume_attachments/4557bf98-ba90-429e-92fb-02fbc229b672 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:49:11.978704 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-b621734f-226f-49d5-b9d7-e82ae271337c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:11.983068 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-b621734f-226f-49d5-b9d7-e82ae271337c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:11.988675 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-d4ece6c3-1a07-4452-8067-06c726e6a27d req-bd92ead7-64bf-427f-8f6a-de9e5f052441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d1d1e2a-ddc9-4a66-8db4-6cccea722024", "tag": "918b2634-4141-429d-95ff-f9bae50b39dc"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:49:11.992447 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b621734f-226f-49d5-b9d7-e82ae271337c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:11.996270 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b621734f-226f-49d5-b9d7-e82ae271337c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:11.996270 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b621734f-226f-49d5-b9d7-e82ae271337c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:11.996270 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b621734f-226f-49d5-b9d7-e82ae271337c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:11.996270 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b621734f-226f-49d5-b9d7-e82ae271337c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:11.996699 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-b621734f-226f-49d5-b9d7-e82ae271337c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:12.001764 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-d4ece6c3-1a07-4452-8067-06c726e6a27d req-bd92ead7-64bf-427f-8f6a-de9e5f052441 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:12.002244 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-d4ece6c3-1a07-4452-8067-06c726e6a27d req-bd92ead7-64bf-427f-8f6a-de9e5f052441 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:12.002713 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-d4ece6c3-1a07-4452-8067-06c726e6a27d req-bd92ead7-64bf-427f-8f6a-de9e5f052441 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:12.019735 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-d4ece6c3-1a07-4452-8067-06c726e6a27d req-bd92ead7-64bf-427f-8f6a-de9e5f052441 service nova] Creating event network-changed:918b2634-4141-429d-95ff-f9bae50b39dc for instance 5d1d1e2a-ddc9-4a66-8db4-6cccea722024 on hv-cinder-77957 Aug 24 13:49:12.028252 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-d4ece6c3-1a07-4452-8067-06c726e6a27d req-bd92ead7-64bf-427f-8f6a-de9e5f052441 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044819 Aug 24 13:49:12.029250 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 554/1089] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:49:12.032251 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-b621734f-226f-49d5-b9d7-e82ae271337c tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062115 Aug 24 13:49:12.033000 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 536/1090] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:49:11 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:49:12.426851 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-308fe9d7-1bdc-4610-b020-6c69ee60d864 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:12.427569 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-308fe9d7-1bdc-4610-b020-6c69ee60d864 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:12.434646 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-308fe9d7-1bdc-4610-b020-6c69ee60d864 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:12.435248 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-308fe9d7-1bdc-4610-b020-6c69ee60d864 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:12.435909 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-308fe9d7-1bdc-4610-b020-6c69ee60d864 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:12.436641 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-308fe9d7-1bdc-4610-b020-6c69ee60d864 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:12.437120 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-308fe9d7-1bdc-4610-b020-6c69ee60d864 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:12.437538 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-308fe9d7-1bdc-4610-b020-6c69ee60d864 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:12.579370 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-308fe9d7-1bdc-4610-b020-6c69ee60d864 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:12.583276 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:49:12.588534 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-308fe9d7-1bdc-4610-b020-6c69ee60d864 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1652 microversion: 2.1 time: 0.166032 Aug 24 13:49:12.589456 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 555/1091] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:12 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1652 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:12.610232 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-fa268f86-bde6-4936-810e-09eda36da308 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:49:12.617829 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fa268f86-bde6-4936-810e-09eda36da308 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:12.618329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fa268f86-bde6-4936-810e-09eda36da308 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:12.618770 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-fa268f86-bde6-4936-810e-09eda36da308 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:12.694129 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-fa268f86-bde6-4936-810e-09eda36da308 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Going to try to start instance {{(pid=133014) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 13:49:12.895569 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-8de80f15-cb9a-41ca-83c4-7198872eb9b8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:12.896337 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-8de80f15-cb9a-41ca-83c4-7198872eb9b8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 5948628b-139a-443c-a9ad-26eaf45599d8] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:12.904248 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8de80f15-cb9a-41ca-83c4-7198872eb9b8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:12.904737 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8de80f15-cb9a-41ca-83c4-7198872eb9b8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:12.905162 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8de80f15-cb9a-41ca-83c4-7198872eb9b8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:12.905860 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8de80f15-cb9a-41ca-83c4-7198872eb9b8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:12.906310 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8de80f15-cb9a-41ca-83c4-7198872eb9b8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:12.906736 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-8de80f15-cb9a-41ca-83c4-7198872eb9b8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:12.915786 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-fa268f86-bde6-4936-810e-09eda36da308 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "POST /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a/action" status: 202 len: 0 microversion: 2.1 time: 0.309375 Aug 24 13:49:12.916860 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 537/1092] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 13:49:12 2022] POST /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:49:12.929260 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-4f3e3b3b-a57e-40d5-9815-8a96314e8443 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:12.930835 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-4f3e3b3b-a57e-40d5-9815-8a96314e8443 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:12.939461 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4f3e3b3b-a57e-40d5-9815-8a96314e8443 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:12.944876 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4f3e3b3b-a57e-40d5-9815-8a96314e8443 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:12.944876 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4f3e3b3b-a57e-40d5-9815-8a96314e8443 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:12.944876 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4f3e3b3b-a57e-40d5-9815-8a96314e8443 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:12.944876 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4f3e3b3b-a57e-40d5-9815-8a96314e8443 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:12.945448 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-4f3e3b3b-a57e-40d5-9815-8a96314e8443 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:12.964888 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:49:13.104960 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-8de80f15-cb9a-41ca-83c4-7198872eb9b8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:13.113160 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-8de80f15-cb9a-41ca-83c4-7198872eb9b8 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8" status: 200 len: 1507 microversion: 2.1 time: 0.222041 Aug 24 13:49:13.113938 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 556/1093] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:12 2022] GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8 => generated 1507 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:49:13.122586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d86f0733-be8b-48e4-9dbb-6532574028d3 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:13.125000 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-d86f0733-be8b-48e4-9dbb-6532574028d3 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:13.129467 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-4f3e3b3b-a57e-40d5-9815-8a96314e8443 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:13.132387 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d86f0733-be8b-48e4-9dbb-6532574028d3 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:13.132983 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d86f0733-be8b-48e4-9dbb-6532574028d3 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:13.133543 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d86f0733-be8b-48e4-9dbb-6532574028d3 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:13.134116 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d86f0733-be8b-48e4-9dbb-6532574028d3 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:13.135791 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d86f0733-be8b-48e4-9dbb-6532574028d3 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:13.135791 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d86f0733-be8b-48e4-9dbb-6532574028d3 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:13.139727 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-4f3e3b3b-a57e-40d5-9815-8a96314e8443 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1661 microversion: 2.1 time: 0.216586 Aug 24 13:49:13.139898 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 538/1094] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:12 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1661 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:13.144900 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-761ec1f0-b03f-402d-b561-ba0457e4d278 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "456c53ee-2701-4635-b72c-12bdcb711698", "device": "/dev/sdb"}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:49:13.148064 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-761ec1f0-b03f-402d-b561-ba0457e4d278 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 5948628b-139a-443c-a9ad-26eaf45599d8] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:13.155258 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-761ec1f0-b03f-402d-b561-ba0457e4d278 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:13.155887 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-761ec1f0-b03f-402d-b561-ba0457e4d278 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:13.156353 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-761ec1f0-b03f-402d-b561-ba0457e4d278 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:13.157080 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-761ec1f0-b03f-402d-b561-ba0457e4d278 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:13.157566 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-761ec1f0-b03f-402d-b561-ba0457e4d278 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:13.158547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-761ec1f0-b03f-402d-b561-ba0457e4d278 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:13.169180 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-d86f0733-be8b-48e4-9dbb-6532574028d3 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050416 Aug 24 13:49:13.172425 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 557/1095] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:49:13 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:49:14.035366 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-761ec1f0-b03f-402d-b561-ba0457e4d278 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "POST /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.894228 Aug 24 13:49:14.036329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 539/1096] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 13:49:13 2022] POST /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8/os-volume_attachments => generated 194 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:49:14.160583 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-858d8d1a-3c07-4ccc-be67-86f3d0d24b81 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:14.161209 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-858d8d1a-3c07-4ccc-be67-86f3d0d24b81 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:14.168085 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-858d8d1a-3c07-4ccc-be67-86f3d0d24b81 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:14.168605 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-858d8d1a-3c07-4ccc-be67-86f3d0d24b81 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:14.169042 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-858d8d1a-3c07-4ccc-be67-86f3d0d24b81 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:14.169742 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-858d8d1a-3c07-4ccc-be67-86f3d0d24b81 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:14.170196 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-858d8d1a-3c07-4ccc-be67-86f3d0d24b81 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:14.170625 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-858d8d1a-3c07-4ccc-be67-86f3d0d24b81 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:14.185103 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-98baac53-a2f2-4a67-a16a-ad426eea4db3 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:14.189421 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-98baac53-a2f2-4a67-a16a-ad426eea4db3 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:14.195904 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-98baac53-a2f2-4a67-a16a-ad426eea4db3 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:14.196442 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-98baac53-a2f2-4a67-a16a-ad426eea4db3 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:14.196891 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-98baac53-a2f2-4a67-a16a-ad426eea4db3 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:14.197623 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-98baac53-a2f2-4a67-a16a-ad426eea4db3 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:14.198080 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-98baac53-a2f2-4a67-a16a-ad426eea4db3 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:14.198509 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-98baac53-a2f2-4a67-a16a-ad426eea4db3 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:14.230036 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-98baac53-a2f2-4a67-a16a-ad426eea4db3 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049893 Aug 24 13:49:14.235303 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 540/1097] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:49:14 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 13:49:14.241602 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-653b7bf8-dcc1-4659-8066-deb156326483 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:14.242107 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-653b7bf8-dcc1-4659-8066-deb156326483 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:14.248814 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-653b7bf8-dcc1-4659-8066-deb156326483 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:14.249308 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-653b7bf8-dcc1-4659-8066-deb156326483 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:14.249751 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-653b7bf8-dcc1-4659-8066-deb156326483 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:14.250457 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-653b7bf8-dcc1-4659-8066-deb156326483 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:14.250932 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-653b7bf8-dcc1-4659-8066-deb156326483 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:14.251355 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-653b7bf8-dcc1-4659-8066-deb156326483 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:14.309991 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-858d8d1a-3c07-4ccc-be67-86f3d0d24b81 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:14.318231 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-858d8d1a-3c07-4ccc-be67-86f3d0d24b81 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1661 microversion: 2.1 time: 0.161462 Aug 24 13:49:14.318947 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 558/1098] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:14 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1661 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:14.331194 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-653b7bf8-dcc1-4659-8066-deb156326483 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] HTTP exception thrown: Instance 5d1d1e2a-ddc9-4a66-8db4-6cccea722024 is not attached to volume 4557bf98-ba90-429e-92fb-02fbc229b672 Aug 24 13:49:14.336762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-653b7bf8-dcc1-4659-8066-deb156326483 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Request method failure captured: Aug 24 13:49:14.336762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: DELETE /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024/os-volume_attachments/4557bf98-ba90-429e-92fb-02fbc229b672 HTTP/1.1 Aug 24 13:49:14.336762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:49:14.336762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:49:14.336762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:49:14.336762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:49:14.336762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:49:14.336762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:49:14.336762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:49:14.336762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:49:14.336762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBiu6itMb5df7s8dxMliF42NMonAC8L8rens0K1MQU5RsnJ_KMPkpegqvh42O-X0TNPUXgd0WPF1-EaVocXxU6SxCOMLWXuTxrp8jTXJ0gDDmTIaUrV1jhlT9DatgiGhdWVYEUpJSTm46k1c59V0-8AVD4Iy1hgVux_vyH2t33I6_53g Aug 24 13:49:14.336762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:49:14.336762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:49:14.336762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:49:14.336762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:49:14.336762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:49:14.336762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:49:14.336762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 6f61a8f100cf4d39928e4d596741e1bb Aug 24 13:49:14.336762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-TestMinimumBasicScenario-967897650 Aug 24 13:49:14.336762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:49:14.336762 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:49:14.338506 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6f61a8f100cf4d39928e4d596741e1bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6f61a8f100cf4d39928e4d596741e1bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6f61a8f100cf4d39928e4d596741e1bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6f61a8f100cf4d39928e4d596741e1bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:49:14.338506 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-TestMinimumBasicScenario-967897650 Aug 24 13:49:14.338506 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 6f61a8f100cf4d39928e4d596741e1bb Aug 24 13:49:14.338506 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-TestMinimumBasicScenario-967897650 Aug 24 13:49:14.338506 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-TestMinimumBasicScenario-967897650-project Aug 24 13:49:14.338506 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:49:14.338506 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:49:14.338506 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: 63c0c061be824eae8d217d7ea32dcd92 Aug 24 13:49:14.338506 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-TestMinimumBasicScenario-967897650-project Aug 24 13:49:14.338506 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:49:14.338506 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Instance 5d1d1e2a-ddc9-4a66-8db4-6cccea722024 is not attached to volume 4557bf98-ba90-429e-92fb-02fbc229b672 Aug 24 13:49:14.339427 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'server_id': '5d1d1e2a-ddc9-4a66-8db4-6cccea722024', 'id': '4557bf98-ba90-429e-92fb-02fbc229b672'} Aug 24 13:49:14.339427 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:49:14.339427 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:49:14.339427 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 13:49:14.339427 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 13:49:14.339427 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 13:49:14.339427 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 13:49:14.339427 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 13:49:14.339427 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 13:49:14.339427 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4557bf98-ba90-429e-92fb-02fbc229b672. Aug 24 13:49:14.339427 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:49:14.339427 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:49:14.339427 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:49:14.339427 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:49:14.339427 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:49:14.339427 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:49:14.339427 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:49:14.339427 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:49:14.339427 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:49:14.340961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:49:14.340961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 13:49:14.340961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 13:49:14.340961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d1d1e2a-ddc9-4a66-8db4-6cccea722024 is not attached to volume 4557bf98-ba90-429e-92fb-02fbc229b672 Aug 24 13:49:14.340961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:49:14.340961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:49:14.340961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:49:14.340961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:49:14.340961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:49:14.340961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:49:14.340961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:49:14.340961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:49:14.340961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d1d1e2a-ddc9-4a66-8db4-6cccea722024 is not attached to volume 4557bf98-ba90-429e-92fb-02fbc229b672 Aug 24 13:49:14.340961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:49:14.340961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-653b7bf8-dcc1-4659-8066-deb156326483 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Returning 404 to user: Instance 5d1d1e2a-ddc9-4a66-8db4-6cccea722024 is not attached to volume 4557bf98-ba90-429e-92fb-02fbc229b672 {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:49:14.342150 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-653b7bf8-dcc1-4659-8066-deb156326483 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024/os-volume_attachments/4557bf98-ba90-429e-92fb-02fbc229b672" status: 404 len: 154 microversion: 2.1 time: 0.101151 Aug 24 13:49:14.342150 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 541/1099] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 13:49:14 2022] DELETE /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024/os-volume_attachments/4557bf98-ba90-429e-92fb-02fbc229b672 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 13:49:15.339207 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-ffbed260-0ae8-4c89-b8b6-c8d1daf9520b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:15.339823 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-ffbed260-0ae8-4c89-b8b6-c8d1daf9520b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:15.346388 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ffbed260-0ae8-4c89-b8b6-c8d1daf9520b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:15.346867 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ffbed260-0ae8-4c89-b8b6-c8d1daf9520b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:15.347376 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ffbed260-0ae8-4c89-b8b6-c8d1daf9520b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:15.347986 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ffbed260-0ae8-4c89-b8b6-c8d1daf9520b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:15.348469 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ffbed260-0ae8-4c89-b8b6-c8d1daf9520b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:15.348889 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ffbed260-0ae8-4c89-b8b6-c8d1daf9520b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:15.491272 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-ffbed260-0ae8-4c89-b8b6-c8d1daf9520b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:15.499466 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-ffbed260-0ae8-4c89-b8b6-c8d1daf9520b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1665 microversion: 2.1 time: 0.164222 Aug 24 13:49:15.500048 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 559/1100] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:15 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1665 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:49:15.690003 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-02f7e635-5674-4b10-b9c7-bb5a4bd944b1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:15.690600 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-02f7e635-5674-4b10-b9c7-bb5a4bd944b1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:15.699170 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-02f7e635-5674-4b10-b9c7-bb5a4bd944b1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:15.704737 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-02f7e635-5674-4b10-b9c7-bb5a4bd944b1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:15.704737 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-02f7e635-5674-4b10-b9c7-bb5a4bd944b1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:15.704737 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-02f7e635-5674-4b10-b9c7-bb5a4bd944b1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:15.704737 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-02f7e635-5674-4b10-b9c7-bb5a4bd944b1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:15.705197 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-02f7e635-5674-4b10-b9c7-bb5a4bd944b1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:15.729383 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-02f7e635-5674-4b10-b9c7-bb5a4bd944b1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Going to try to terminate instance {{(pid=133014) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 13:49:16.067040 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-02f7e635-5674-4b10-b9c7-bb5a4bd944b1 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 204 len: 0 microversion: 2.1 time: 0.380441 Aug 24 13:49:16.067569 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 542/1101] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:49:15 2022] DELETE /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:49:16.076641 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-91fa5ae0-6962-43cf-b96e-cb541a1c5556 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:16.077295 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-91fa5ae0-6962-43cf-b96e-cb541a1c5556 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:16.083940 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-91fa5ae0-6962-43cf-b96e-cb541a1c5556 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:16.085392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-91fa5ae0-6962-43cf-b96e-cb541a1c5556 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:16.085392 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-91fa5ae0-6962-43cf-b96e-cb541a1c5556 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:16.086074 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-91fa5ae0-6962-43cf-b96e-cb541a1c5556 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:16.086536 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-91fa5ae0-6962-43cf-b96e-cb541a1c5556 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:16.086961 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-91fa5ae0-6962-43cf-b96e-cb541a1c5556 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:16.235360 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-91fa5ae0-6962-43cf-b96e-cb541a1c5556 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:16.244656 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-91fa5ae0-6962-43cf-b96e-cb541a1c5556 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1556 microversion: 2.1 time: 0.171810 Aug 24 13:49:16.245246 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 560/1102] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:16 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:17.271435 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-13960fe9-8919-439f-9d7f-fc67e3c9e117 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:17.272745 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-13960fe9-8919-439f-9d7f-fc67e3c9e117 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:17.283589 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-13960fe9-8919-439f-9d7f-fc67e3c9e117 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:17.284671 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-13960fe9-8919-439f-9d7f-fc67e3c9e117 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:17.285004 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-13960fe9-8919-439f-9d7f-fc67e3c9e117 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:17.285878 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-13960fe9-8919-439f-9d7f-fc67e3c9e117 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:17.286453 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-13960fe9-8919-439f-9d7f-fc67e3c9e117 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:17.287523 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-13960fe9-8919-439f-9d7f-fc67e3c9e117 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:17.441140 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-13960fe9-8919-439f-9d7f-fc67e3c9e117 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:17.449335 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-13960fe9-8919-439f-9d7f-fc67e3c9e117 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1556 microversion: 2.1 time: 0.185444 Aug 24 13:49:17.449904 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 543/1103] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:17 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1556 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:18.470488 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-c66d93de-bb61-4520-bf4a-040737dc6323 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:18.471759 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-c66d93de-bb61-4520-bf4a-040737dc6323 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:18.480128 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c66d93de-bb61-4520-bf4a-040737dc6323 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:18.488628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c66d93de-bb61-4520-bf4a-040737dc6323 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:18.488628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c66d93de-bb61-4520-bf4a-040737dc6323 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:18.488628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c66d93de-bb61-4520-bf4a-040737dc6323 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:18.488628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c66d93de-bb61-4520-bf4a-040737dc6323 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:18.489071 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c66d93de-bb61-4520-bf4a-040737dc6323 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:18.633323 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c66d93de-bb61-4520-bf4a-040737dc6323 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:18.641574 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-c66d93de-bb61-4520-bf4a-040737dc6323 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1556 microversion: 2.1 time: 0.174993 Aug 24 13:49:18.642180 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 561/1104] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:18 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:19.085466 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-bb5300a6-446a-4ffc-ab25-3f45ad4273f5 req-714020c9-e5bc-47a8-aaa8-9297d41cfdbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d1d1e2a-ddc9-4a66-8db4-6cccea722024", "name": "network-vif-deleted", "tag": "918b2634-4141-429d-95ff-f9bae50b39dc"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:49:19.095329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-bb5300a6-446a-4ffc-ab25-3f45ad4273f5 req-714020c9-e5bc-47a8-aaa8-9297d41cfdbe service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:19.095937 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-bb5300a6-446a-4ffc-ab25-3f45ad4273f5 req-714020c9-e5bc-47a8-aaa8-9297d41cfdbe service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:19.096415 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-bb5300a6-446a-4ffc-ab25-3f45ad4273f5 req-714020c9-e5bc-47a8-aaa8-9297d41cfdbe service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:19.109814 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-bb5300a6-446a-4ffc-ab25-3f45ad4273f5 req-714020c9-e5bc-47a8-aaa8-9297d41cfdbe service nova] Creating event network-vif-deleted:918b2634-4141-429d-95ff-f9bae50b39dc for instance 5d1d1e2a-ddc9-4a66-8db4-6cccea722024 on hv-cinder-77957 Aug 24 13:49:19.114807 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-bb5300a6-446a-4ffc-ab25-3f45ad4273f5 req-714020c9-e5bc-47a8-aaa8-9297d41cfdbe service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110295 Aug 24 13:49:19.116400 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 544/1105] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:49:19.663615 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-cf2e9d9a-4bbe-4a9e-9248-9b4b24f1f191 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:19.664226 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-cf2e9d9a-4bbe-4a9e-9248-9b4b24f1f191 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:19.670915 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cf2e9d9a-4bbe-4a9e-9248-9b4b24f1f191 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:19.671399 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cf2e9d9a-4bbe-4a9e-9248-9b4b24f1f191 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:19.671839 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cf2e9d9a-4bbe-4a9e-9248-9b4b24f1f191 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:19.672567 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cf2e9d9a-4bbe-4a9e-9248-9b4b24f1f191 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:19.673022 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cf2e9d9a-4bbe-4a9e-9248-9b4b24f1f191 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:19.673446 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cf2e9d9a-4bbe-4a9e-9248-9b4b24f1f191 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:19.706813 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cf2e9d9a-4bbe-4a9e-9248-9b4b24f1f191 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:19.707302 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cf2e9d9a-4bbe-4a9e-9248-9b4b24f1f191 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:19.707741 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-cf2e9d9a-4bbe-4a9e-9248-9b4b24f1f191 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:19.708215 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.objects.instance [None req-cf2e9d9a-4bbe-4a9e-9248-9b4b24f1f191 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lazy-loading 'fault' on Instance uuid 5d1d1e2a-ddc9-4a66-8db4-6cccea722024 {{(pid=133015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:49:19.752137 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-cf2e9d9a-4bbe-4a9e-9248-9b4b24f1f191 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63c0c061be824eae8d217d7ea32dcd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f61a8f100cf4d39928e4d596741e1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:19.760571 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-cf2e9d9a-4bbe-4a9e-9248-9b4b24f1f191 tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 200 len: 1349 microversion: 2.1 time: 0.101033 Aug 24 13:49:19.761155 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 562/1106] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:19 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 1349 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:20.781855 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-d8ede273-54e0-4de8-8439-b15e903c3aca tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:20.782565 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-d8ede273-54e0-4de8-8439-b15e903c3aca tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] [instance: 5d1d1e2a-ddc9-4a66-8db4-6cccea722024] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:20.790973 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d8ede273-54e0-4de8-8439-b15e903c3aca tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:20.791470 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d8ede273-54e0-4de8-8439-b15e903c3aca tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:20.791920 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d8ede273-54e0-4de8-8439-b15e903c3aca tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:20.792659 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d8ede273-54e0-4de8-8439-b15e903c3aca tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:20.793119 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d8ede273-54e0-4de8-8439-b15e903c3aca tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:20.793547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-d8ede273-54e0-4de8-8439-b15e903c3aca tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:20.807983 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-d8ede273-54e0-4de8-8439-b15e903c3aca tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] HTTP exception thrown: Instance 5d1d1e2a-ddc9-4a66-8db4-6cccea722024 could not be found. Aug 24 13:49:20.809743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-d8ede273-54e0-4de8-8439-b15e903c3aca tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Request method failure captured: Aug 24 13:49:20.809743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 HTTP/1.1 Aug 24 13:49:20.809743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:49:20.809743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:49:20.809743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:49:20.809743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:49:20.809743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:49:20.809743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:49:20.809743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:49:20.809743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:49:20.809743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBiu6itMb5df7s8dxMliF42NMonAC8L8rens0K1MQU5RsnJ_KMPkpegqvh42O-X0TNPUXgd0WPF1-EaVocXxU6SxCOMLWXuTxrp8jTXJ0gDDmTIaUrV1jhlT9DatgiGhdWVYEUpJSTm46k1c59V0-8AVD4Iy1hgVux_vyH2t33I6_53g Aug 24 13:49:20.809743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:49:20.809743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:49:20.809743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:49:20.809743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:49:20.809743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:49:20.809743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:49:20.809743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 6f61a8f100cf4d39928e4d596741e1bb Aug 24 13:49:20.809743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-TestMinimumBasicScenario-967897650 Aug 24 13:49:20.809743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:49:20.809743 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:49:20.811164 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6f61a8f100cf4d39928e4d596741e1bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6f61a8f100cf4d39928e4d596741e1bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6f61a8f100cf4d39928e4d596741e1bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6f61a8f100cf4d39928e4d596741e1bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:49:20.811164 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-TestMinimumBasicScenario-967897650 Aug 24 13:49:20.811164 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 6f61a8f100cf4d39928e4d596741e1bb Aug 24 13:49:20.811164 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-TestMinimumBasicScenario-967897650 Aug 24 13:49:20.811164 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-TestMinimumBasicScenario-967897650-project Aug 24 13:49:20.811164 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:49:20.811164 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:49:20.811164 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: 63c0c061be824eae8d217d7ea32dcd92 Aug 24 13:49:20.811164 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-TestMinimumBasicScenario-967897650-project Aug 24 13:49:20.811164 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:49:20.811164 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Instance 5d1d1e2a-ddc9-4a66-8db4-6cccea722024 could not be found. Aug 24 13:49:20.811164 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': '5d1d1e2a-ddc9-4a66-8db4-6cccea722024'} Aug 24 13:49:20.811929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:49:20.811929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:49:20.811929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:49:20.811929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:49:20.811929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:49:20.811929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:49:20.811929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:49:20.811929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:49:20.811929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:49:20.811929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:49:20.811929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d1d1e2a-ddc9-4a66-8db4-6cccea722024 could not be found. Aug 24 13:49:20.811929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:49:20.811929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:49:20.811929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:49:20.811929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:49:20.811929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:49:20.811929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:49:20.811929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:49:20.811929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:49:20.811929 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:49:20.813472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:49:20.813472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:49:20.813472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:49:20.813472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:49:20.813472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:49:20.813472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:49:20.813472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:49:20.813472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d1d1e2a-ddc9-4a66-8db4-6cccea722024 could not be found. Aug 24 13:49:20.813472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:49:20.813472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:49:20.813472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:49:20.813472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:49:20.813472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:49:20.813472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:49:20.813472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:49:20.813472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:49:20.813472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d1d1e2a-ddc9-4a66-8db4-6cccea722024 could not be found. Aug 24 13:49:20.813472 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:49:20.815066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-d8ede273-54e0-4de8-8439-b15e903c3aca tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Returning 404 to user: Instance 5d1d1e2a-ddc9-4a66-8db4-6cccea722024 could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:49:20.815066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-d8ede273-54e0-4de8-8439-b15e903c3aca tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024" status: 404 len: 111 microversion: 2.1 time: 0.033686 Aug 24 13:49:20.815066 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 545/1107] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:20 2022] GET /compute/v2.1/servers/5d1d1e2a-ddc9-4a66-8db4-6cccea722024 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:49:20.821591 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-aec54e14-2708-4443-906d-f1d08df1556e tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] Calling method '.version_select at 0x7f96c1fb33a0>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:20.901387 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-aec54e14-2708-4443-906d-f1d08df1556e tempest-TestMinimumBasicScenario-967897650 tempest-TestMinimumBasicScenario-967897650-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1238026471" status: 202 len: 0 microversion: 2.1 time: 0.083662 Aug 24 13:49:20.901983 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 563/1108] 10.222.0.73 () {58 vars in 1272 bytes} [Wed Aug 24 13:49:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1238026471 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 13:49:35.391517 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-8d259d84-fe95-4c8b-9867-16f28764ff8e tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:35.392037 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-8d259d84-fe95-4c8b-9867-16f28764ff8e tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 5948628b-139a-443c-a9ad-26eaf45599d8] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:35.394730 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:49:35.395485 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:49:35.400169 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8d259d84-fe95-4c8b-9867-16f28764ff8e tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:35.400688 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8d259d84-fe95-4c8b-9867-16f28764ff8e tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:35.401128 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8d259d84-fe95-4c8b-9867-16f28764ff8e tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:35.401820 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8d259d84-fe95-4c8b-9867-16f28764ff8e tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:35.402277 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8d259d84-fe95-4c8b-9867-16f28764ff8e tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:35.402704 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8d259d84-fe95-4c8b-9867-16f28764ff8e tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:35.482580 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.objects.instance [None req-8d259d84-fe95-4c8b-9867-16f28764ff8e tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lazy-loading 'services' on Instance uuid 5948628b-139a-443c-a9ad-26eaf45599d8 {{(pid=133014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:49:35.728989 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-8d259d84-fe95-4c8b-9867-16f28764ff8e tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8/os-volume_attachments/456c53ee-2701-4635-b72c-12bdcb711698" status: 202 len: 0 microversion: 2.1 time: 0.341331 Aug 24 13:49:35.729581 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 546/1109] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 13:49:35 2022] DELETE /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8/os-volume_attachments/456c53ee-2701-4635-b72c-12bdcb711698 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:49:37.905127 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=44 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:49:37.905871 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:49:37.909788 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-a2291864-6adc-4877-a709-8e512e279411 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:37.910284 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-a2291864-6adc-4877-a709-8e512e279411 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 5948628b-139a-443c-a9ad-26eaf45599d8] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:37.916731 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a2291864-6adc-4877-a709-8e512e279411 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:37.917208 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a2291864-6adc-4877-a709-8e512e279411 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:37.920683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a2291864-6adc-4877-a709-8e512e279411 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:37.920683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a2291864-6adc-4877-a709-8e512e279411 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:37.920683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a2291864-6adc-4877-a709-8e512e279411 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:37.920683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-a2291864-6adc-4877-a709-8e512e279411 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:37.949475 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-a2291864-6adc-4877-a709-8e512e279411 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 5948628b-139a-443c-a9ad-26eaf45599d8] Going to try to terminate instance {{(pid=133015) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 13:49:38.237428 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-a2291864-6adc-4877-a709-8e512e279411 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8" status: 204 len: 0 microversion: 2.1 time: 0.333291 Aug 24 13:49:38.237942 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 564/1110] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:49:37 2022] DELETE /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:49:38.248028 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-c2081e77-ffae-48fb-863f-6196c6c6e9b5 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:38.248778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-c2081e77-ffae-48fb-863f-6196c6c6e9b5 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 5948628b-139a-443c-a9ad-26eaf45599d8] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:38.255559 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c2081e77-ffae-48fb-863f-6196c6c6e9b5 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:38.256039 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c2081e77-ffae-48fb-863f-6196c6c6e9b5 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:38.256733 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c2081e77-ffae-48fb-863f-6196c6c6e9b5 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:38.257517 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c2081e77-ffae-48fb-863f-6196c6c6e9b5 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:38.257975 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c2081e77-ffae-48fb-863f-6196c6c6e9b5 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:38.258409 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c2081e77-ffae-48fb-863f-6196c6c6e9b5 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:38.637596 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-c2081e77-ffae-48fb-863f-6196c6c6e9b5 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:38.645538 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-c2081e77-ffae-48fb-863f-6196c6c6e9b5 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8" status: 200 len: 1513 microversion: 2.1 time: 0.402199 Aug 24 13:49:38.646190 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 547/1111] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:38 2022] GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8 => generated 1513 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:49:39.668307 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-dff655c5-f6d4-4182-b74e-82623dbb623c tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:39.669010 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-dff655c5-f6d4-4182-b74e-82623dbb623c tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 5948628b-139a-443c-a9ad-26eaf45599d8] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:39.675699 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dff655c5-f6d4-4182-b74e-82623dbb623c tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:39.676209 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dff655c5-f6d4-4182-b74e-82623dbb623c tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:39.676638 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dff655c5-f6d4-4182-b74e-82623dbb623c tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:39.677328 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dff655c5-f6d4-4182-b74e-82623dbb623c tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:39.677868 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dff655c5-f6d4-4182-b74e-82623dbb623c tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:39.678292 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-dff655c5-f6d4-4182-b74e-82623dbb623c tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:39.813936 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-dff655c5-f6d4-4182-b74e-82623dbb623c tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:39.822260 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-dff655c5-f6d4-4182-b74e-82623dbb623c tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8" status: 200 len: 1513 microversion: 2.1 time: 0.158882 Aug 24 13:49:39.822839 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 565/1112] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:39 2022] GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:40.843031 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-bd162f18-d704-43d0-b51f-46d18cacce32 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:40.843662 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-bd162f18-d704-43d0-b51f-46d18cacce32 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 5948628b-139a-443c-a9ad-26eaf45599d8] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:40.849983 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd162f18-d704-43d0-b51f-46d18cacce32 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:40.850473 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd162f18-d704-43d0-b51f-46d18cacce32 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:40.850966 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd162f18-d704-43d0-b51f-46d18cacce32 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:40.852110 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd162f18-d704-43d0-b51f-46d18cacce32 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:40.852597 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd162f18-d704-43d0-b51f-46d18cacce32 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:40.853027 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-bd162f18-d704-43d0-b51f-46d18cacce32 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:40.985272 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-bd162f18-d704-43d0-b51f-46d18cacce32 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:40.993638 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-bd162f18-d704-43d0-b51f-46d18cacce32 tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8" status: 200 len: 1513 microversion: 2.1 time: 0.154527 Aug 24 13:49:40.994190 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 548/1113] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:40 2022] GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:41.094880 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-0ea76f74-d2f6-4c4d-92e0-f2e6563ceee2 req-34c30695-1bcb-46d2-82f0-25b8458ef1ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5948628b-139a-443c-a9ad-26eaf45599d8", "name": "network-vif-deleted", "tag": "2cafb065-bf32-49fa-b7f7-fbb889ee1127"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:49:41.105565 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-0ea76f74-d2f6-4c4d-92e0-f2e6563ceee2 req-34c30695-1bcb-46d2-82f0-25b8458ef1ea service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:41.106039 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-0ea76f74-d2f6-4c4d-92e0-f2e6563ceee2 req-34c30695-1bcb-46d2-82f0-25b8458ef1ea service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:41.106461 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-0ea76f74-d2f6-4c4d-92e0-f2e6563ceee2 req-34c30695-1bcb-46d2-82f0-25b8458ef1ea service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:41.118172 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-0ea76f74-d2f6-4c4d-92e0-f2e6563ceee2 req-34c30695-1bcb-46d2-82f0-25b8458ef1ea service nova] Creating event network-vif-deleted:2cafb065-bf32-49fa-b7f7-fbb889ee1127 for instance 5948628b-139a-443c-a9ad-26eaf45599d8 on hv-cinder-77957 Aug 24 13:49:41.123180 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-0ea76f74-d2f6-4c4d-92e0-f2e6563ceee2 req-34c30695-1bcb-46d2-82f0-25b8458ef1ea service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032228 Aug 24 13:49:41.124026 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 566/1114] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:49:42.014979 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-27408adf-67bb-416b-9410-2494945d238d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:42.015527 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-27408adf-67bb-416b-9410-2494945d238d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 5948628b-139a-443c-a9ad-26eaf45599d8] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:42.022021 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-27408adf-67bb-416b-9410-2494945d238d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:42.022534 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-27408adf-67bb-416b-9410-2494945d238d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:42.022937 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-27408adf-67bb-416b-9410-2494945d238d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:42.024009 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-27408adf-67bb-416b-9410-2494945d238d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:42.024377 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-27408adf-67bb-416b-9410-2494945d238d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:42.024807 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-27408adf-67bb-416b-9410-2494945d238d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:42.061839 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-27408adf-67bb-416b-9410-2494945d238d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:42.062324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-27408adf-67bb-416b-9410-2494945d238d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:42.062949 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-27408adf-67bb-416b-9410-2494945d238d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:42.063405 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.objects.instance [None req-27408adf-67bb-416b-9410-2494945d238d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lazy-loading 'fault' on Instance uuid 5948628b-139a-443c-a9ad-26eaf45599d8 {{(pid=133014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:49:42.107229 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-27408adf-67bb-416b-9410-2494945d238d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ee68b458234fe482b5c2e777b71967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7c5f7e89a74cab86be21c2bb4819ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:42.115013 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-27408adf-67bb-416b-9410-2494945d238d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8" status: 200 len: 1309 microversion: 2.1 time: 0.104070 Aug 24 13:49:42.115603 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 549/1115] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:42 2022] GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8 => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:49:43.137528 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-bb97b30f-4f66-41b9-89eb-543a39db5e1d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:43.138232 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-bb97b30f-4f66-41b9-89eb-543a39db5e1d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] [instance: 5948628b-139a-443c-a9ad-26eaf45599d8] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:43.145119 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bb97b30f-4f66-41b9-89eb-543a39db5e1d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:43.145607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bb97b30f-4f66-41b9-89eb-543a39db5e1d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:43.146037 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bb97b30f-4f66-41b9-89eb-543a39db5e1d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:43.146726 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bb97b30f-4f66-41b9-89eb-543a39db5e1d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:43.147178 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bb97b30f-4f66-41b9-89eb-543a39db5e1d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:43.147594 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-bb97b30f-4f66-41b9-89eb-543a39db5e1d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:43.162090 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.wsgi [None req-bb97b30f-4f66-41b9-89eb-543a39db5e1d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] HTTP exception thrown: Instance 5948628b-139a-443c-a9ad-26eaf45599d8 could not be found. Aug 24 13:49:43.163771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-bb97b30f-4f66-41b9-89eb-543a39db5e1d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Request method failure captured: Aug 24 13:49:43.163771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8 HTTP/1.1 Aug 24 13:49:43.163771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:49:43.163771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:49:43.163771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:49:43.163771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 0 Aug 24 13:49:43.163771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:49:43.163771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:49:43.163771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:49:43.163771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:49:43.163771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBiv2pOg-prB4ejJ32KKGxmLOWxXUGO4iJERVjN9_y1oI7IU6xGJzEODSkYfCVrUYUA0JiGFuXfEyFmApz4BaXYXAKiy_VA-tXBG7z0FIQ5Un5dibI0DspN2K2CcqYya2Cn6KAPDo2DFSUn7t_m0XvFLRLkv261pUYEXkko1SCbTvQPE Aug 24 13:49:43.163771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:49:43.163771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:49:43.163771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:49:43.163771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:49:43.163771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:49:43.163771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:49:43.163771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: 1a7c5f7e89a74cab86be21c2bb4819ab Aug 24 13:49:43.163771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1338797284 Aug 24 13:49:43.163771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:49:43.163771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:49:43.165493 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1a7c5f7e89a74cab86be21c2bb4819ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1a7c5f7e89a74cab86be21c2bb4819ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1a7c5f7e89a74cab86be21c2bb4819ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1a7c5f7e89a74cab86be21c2bb4819ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:49:43.165493 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-VolumesSnapshotTestJSON-1338797284 Aug 24 13:49:43.165493 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: 1a7c5f7e89a74cab86be21c2bb4819ab Aug 24 13:49:43.165493 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1338797284 Aug 24 13:49:43.165493 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-VolumesSnapshotTestJSON-1338797284-project Aug 24 13:49:43.165493 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:49:43.165493 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:49:43.165493 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: e9ee68b458234fe482b5c2e777b71967 Aug 24 13:49:43.165493 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-VolumesSnapshotTestJSON-1338797284-project Aug 24 13:49:43.165493 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: > Aug 24 13:49:43.165493 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Instance 5948628b-139a-443c-a9ad-26eaf45599d8 could not be found. Aug 24 13:49:43.165493 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'id': '5948628b-139a-443c-a9ad-26eaf45599d8'} Aug 24 13:49:43.166589 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:49:43.166589 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:49:43.166589 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:49:43.166589 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:49:43.166589 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:49:43.166589 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:49:43.166589 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:49:43.166589 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:49:43.166589 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:49:43.166589 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:49:43.166589 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5948628b-139a-443c-a9ad-26eaf45599d8 could not be found. Aug 24 13:49:43.166589 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:49:43.166589 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:49:43.166589 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:49:43.166589 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:49:43.166589 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:49:43.166589 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:49:43.166589 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:49:43.166589 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:49:43.166589 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:49:43.168400 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:49:43.168400 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:49:43.168400 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:49:43.168400 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:49:43.168400 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:49:43.168400 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:49:43.168400 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:49:43.168400 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5948628b-139a-443c-a9ad-26eaf45599d8 could not be found. Aug 24 13:49:43.168400 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:49:43.168400 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:49:43.168400 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:49:43.168400 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:49:43.168400 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:49:43.168400 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:49:43.168400 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:49:43.168400 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:49:43.168400 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5948628b-139a-443c-a9ad-26eaf45599d8 could not be found. Aug 24 13:49:43.168400 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:49:43.169834 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-bb97b30f-4f66-41b9-89eb-543a39db5e1d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] Returning 404 to user: Instance 5948628b-139a-443c-a9ad-26eaf45599d8 could not be found. {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:49:43.169834 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-bb97b30f-4f66-41b9-89eb-543a39db5e1d tempest-VolumesSnapshotTestJSON-1338797284 tempest-VolumesSnapshotTestJSON-1338797284-project] 10.222.0.73 "GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8" status: 404 len: 111 microversion: 2.1 time: 0.032511 Aug 24 13:49:43.169834 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 567/1116] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:43 2022] GET /compute/v2.1/servers/5948628b-139a-443c-a9ad-26eaf45599d8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:49:58.481204 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-9fac0a76-0cbb-4593-8376-184dc53706c5 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:58.483442 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-9fac0a76-0cbb-4593-8376-184dc53706c5 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:58.486097 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_api:SELECT=10 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:49:58.486768 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:49:58.491484 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9fac0a76-0cbb-4593-8376-184dc53706c5 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:58.491979 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9fac0a76-0cbb-4593-8376-184dc53706c5 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:58.492453 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9fac0a76-0cbb-4593-8376-184dc53706c5 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:58.493164 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9fac0a76-0cbb-4593-8376-184dc53706c5 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:58.493623 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9fac0a76-0cbb-4593-8376-184dc53706c5 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:58.494080 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-9fac0a76-0cbb-4593-8376-184dc53706c5 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:58.526626 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-9fac0a76-0cbb-4593-8376-184dc53706c5 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049033 Aug 24 13:49:58.527206 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 550/1117] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:49:58 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 13:49:58.595360 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-daf872d2-21b0-4436-969f-04d36b095e19 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:58.595928 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-daf872d2-21b0-4436-969f-04d36b095e19 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:58.598120 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:49:58.598772 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:49:58.603736 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-daf872d2-21b0-4436-969f-04d36b095e19 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:58.604294 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-daf872d2-21b0-4436-969f-04d36b095e19 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:58.604668 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-daf872d2-21b0-4436-969f-04d36b095e19 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:58.605361 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-daf872d2-21b0-4436-969f-04d36b095e19 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:58.605878 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-daf872d2-21b0-4436-969f-04d36b095e19 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:58.606298 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-daf872d2-21b0-4436-969f-04d36b095e19 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:58.634699 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-daf872d2-21b0-4436-969f-04d36b095e19 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Going to try to terminate instance {{(pid=133015) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 13:49:58.973823 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-daf872d2-21b0-4436-969f-04d36b095e19 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "DELETE /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 204 len: 0 microversion: 2.1 time: 0.382774 Aug 24 13:49:58.974460 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 568/1118] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:49:58 2022] DELETE /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:49:58.983570 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-27796ea6-f99b-4da6-a63f-49dab09be7cc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:49:58.984231 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-27796ea6-f99b-4da6-a63f-49dab09be7cc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:49:58.990747 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-27796ea6-f99b-4da6-a63f-49dab09be7cc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:58.991238 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-27796ea6-f99b-4da6-a63f-49dab09be7cc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:58.991674 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-27796ea6-f99b-4da6-a63f-49dab09be7cc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:58.992401 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-27796ea6-f99b-4da6-a63f-49dab09be7cc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:49:58.992857 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-27796ea6-f99b-4da6-a63f-49dab09be7cc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:49:58.993289 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-27796ea6-f99b-4da6-a63f-49dab09be7cc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:49:59.142792 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-27796ea6-f99b-4da6-a63f-49dab09be7cc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:49:59.151127 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-27796ea6-f99b-4da6-a63f-49dab09be7cc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1671 microversion: 2.1 time: 0.172093 Aug 24 13:49:59.151753 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 551/1119] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:49:58 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1671 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:50:00.173398 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-53df1c1c-c44f-4b1f-8a1f-b49516158e32 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:00.174140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-53df1c1c-c44f-4b1f-8a1f-b49516158e32 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:00.180571 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-53df1c1c-c44f-4b1f-8a1f-b49516158e32 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:00.186388 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-53df1c1c-c44f-4b1f-8a1f-b49516158e32 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:00.186388 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-53df1c1c-c44f-4b1f-8a1f-b49516158e32 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:00.186388 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-53df1c1c-c44f-4b1f-8a1f-b49516158e32 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:00.186388 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-53df1c1c-c44f-4b1f-8a1f-b49516158e32 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:00.186767 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-53df1c1c-c44f-4b1f-8a1f-b49516158e32 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:00.321197 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-53df1c1c-c44f-4b1f-8a1f-b49516158e32 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:50:00.329715 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-53df1c1c-c44f-4b1f-8a1f-b49516158e32 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1671 microversion: 2.1 time: 0.160562 Aug 24 13:50:00.330290 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 569/1120] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:00 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:50:01.351298 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-acaf8e3b-869f-4526-8248-c590b582c327 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:01.351825 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-acaf8e3b-869f-4526-8248-c590b582c327 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:01.358960 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-acaf8e3b-869f-4526-8248-c590b582c327 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:01.359455 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-acaf8e3b-869f-4526-8248-c590b582c327 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:01.360039 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-acaf8e3b-869f-4526-8248-c590b582c327 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:01.360974 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-acaf8e3b-869f-4526-8248-c590b582c327 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:01.361179 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-acaf8e3b-869f-4526-8248-c590b582c327 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:01.361605 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-acaf8e3b-869f-4526-8248-c590b582c327 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:01.499739 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-acaf8e3b-869f-4526-8248-c590b582c327 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:50:01.507527 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-acaf8e3b-869f-4526-8248-c590b582c327 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1671 microversion: 2.1 time: 0.160201 Aug 24 13:50:01.508081 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 552/1121] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:01 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:50:02.530448 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-69e908aa-0685-49f8-8a40-8fd7efe1118c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:02.531800 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-69e908aa-0685-49f8-8a40-8fd7efe1118c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:02.540129 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-69e908aa-0685-49f8-8a40-8fd7efe1118c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:02.540950 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-69e908aa-0685-49f8-8a40-8fd7efe1118c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:02.542765 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-69e908aa-0685-49f8-8a40-8fd7efe1118c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:02.543769 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-69e908aa-0685-49f8-8a40-8fd7efe1118c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:02.544437 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-69e908aa-0685-49f8-8a40-8fd7efe1118c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:02.545247 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-69e908aa-0685-49f8-8a40-8fd7efe1118c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:02.623370 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-6b5cd31c-3515-415c-bc02-02a5e21035db req-d126c363-a93d-410b-9836-07e1311c6db1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b97d61-96c0-459d-83c5-ebd1929f344a", "name": "network-vif-deleted", "tag": "7197ae76-1beb-430e-a9cf-620230d08e49"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:50:02.641355 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-6b5cd31c-3515-415c-bc02-02a5e21035db req-d126c363-a93d-410b-9836-07e1311c6db1 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:02.642641 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-6b5cd31c-3515-415c-bc02-02a5e21035db req-d126c363-a93d-410b-9836-07e1311c6db1 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:02.643669 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-6b5cd31c-3515-415c-bc02-02a5e21035db req-d126c363-a93d-410b-9836-07e1311c6db1 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:02.658902 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-6b5cd31c-3515-415c-bc02-02a5e21035db req-d126c363-a93d-410b-9836-07e1311c6db1 service nova] Creating event network-vif-deleted:7197ae76-1beb-430e-a9cf-620230d08e49 for instance 31b97d61-96c0-459d-83c5-ebd1929f344a on hv-cinder-77957 Aug 24 13:50:02.669366 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-6b5cd31c-3515-415c-bc02-02a5e21035db req-d126c363-a93d-410b-9836-07e1311c6db1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050708 Aug 24 13:50:02.670562 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 553/1122] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:50:02.685844 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-69e908aa-0685-49f8-8a40-8fd7efe1118c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:50:02.697330 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-69e908aa-0685-49f8-8a40-8fd7efe1118c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1604 microversion: 2.1 time: 0.171218 Aug 24 13:50:02.698813 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 570/1123] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:02 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1604 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:50:03.323552 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-4bb1bc47-7437-43a0-9752-3681ac289513 req-10f31946-7eeb-4e19-b364-6dd299c898e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6731688e-fae7-4e0d-ba98-11b4aa105a41", "tag": "6974fab0-e16f-4683-b4b3-3d4218fb55a8"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:50:03.324511 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-3f5b8646-44f4-4051-8451-231ed529b244 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:03.325451 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-3f5b8646-44f4-4051-8451-231ed529b244 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:03.335501 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-4bb1bc47-7437-43a0-9752-3681ac289513 req-10f31946-7eeb-4e19-b364-6dd299c898e2 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:03.336082 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-4bb1bc47-7437-43a0-9752-3681ac289513 req-10f31946-7eeb-4e19-b364-6dd299c898e2 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:03.336599 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-4bb1bc47-7437-43a0-9752-3681ac289513 req-10f31946-7eeb-4e19-b364-6dd299c898e2 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:03.340028 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3f5b8646-44f4-4051-8451-231ed529b244 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:03.341213 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3f5b8646-44f4-4051-8451-231ed529b244 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:03.349058 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3f5b8646-44f4-4051-8451-231ed529b244 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:03.349058 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3f5b8646-44f4-4051-8451-231ed529b244 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:03.349058 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3f5b8646-44f4-4051-8451-231ed529b244 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:03.349058 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-3f5b8646-44f4-4051-8451-231ed529b244 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:03.351006 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-4bb1bc47-7437-43a0-9752-3681ac289513 req-10f31946-7eeb-4e19-b364-6dd299c898e2 service nova] Creating event network-changed:6974fab0-e16f-4683-b4b3-3d4218fb55a8 for instance 6731688e-fae7-4e0d-ba98-11b4aa105a41 on hv-cinder-77957 Aug 24 13:50:03.357293 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-4bb1bc47-7437-43a0-9752-3681ac289513 req-10f31946-7eeb-4e19-b364-6dd299c898e2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037879 Aug 24 13:50:03.362761 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 571/1124] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:50:03.376266 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-3f5b8646-44f4-4051-8451-231ed529b244 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Going to try to terminate instance {{(pid=133014) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 13:50:03.728656 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-d308227d-6b8f-4219-b8db-27185f7da782 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:03.730002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-d308227d-6b8f-4219-b8db-27185f7da782 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:03.752232 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d308227d-6b8f-4219-b8db-27185f7da782 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:03.752586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d308227d-6b8f-4219-b8db-27185f7da782 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:03.753033 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d308227d-6b8f-4219-b8db-27185f7da782 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:03.753747 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d308227d-6b8f-4219-b8db-27185f7da782 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:03.754204 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d308227d-6b8f-4219-b8db-27185f7da782 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:03.762920 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d308227d-6b8f-4219-b8db-27185f7da782 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:03.769615 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-3f5b8646-44f4-4051-8451-231ed529b244 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41" status: 204 len: 0 microversion: 2.1 time: 0.455992 Aug 24 13:50:03.773709 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 554/1125] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:50:03 2022] DELETE /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:50:03.788553 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-50a38ec2-9fb1-4bd2-ab7b-63ad856f65b5 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:03.790079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-50a38ec2-9fb1-4bd2-ab7b-63ad856f65b5 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:03.815089 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-50a38ec2-9fb1-4bd2-ab7b-63ad856f65b5 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:03.815403 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d308227d-6b8f-4219-b8db-27185f7da782 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:03.816101 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d308227d-6b8f-4219-b8db-27185f7da782 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:03.816262 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-50a38ec2-9fb1-4bd2-ab7b-63ad856f65b5 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:03.817065 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-d308227d-6b8f-4219-b8db-27185f7da782 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:03.817457 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-50a38ec2-9fb1-4bd2-ab7b-63ad856f65b5 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:03.818133 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.objects.instance [None req-d308227d-6b8f-4219-b8db-27185f7da782 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lazy-loading 'fault' on Instance uuid 31b97d61-96c0-459d-83c5-ebd1929f344a {{(pid=133015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:50:03.818374 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-50a38ec2-9fb1-4bd2-ab7b-63ad856f65b5 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:03.818954 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-50a38ec2-9fb1-4bd2-ab7b-63ad856f65b5 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:03.819784 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-50a38ec2-9fb1-4bd2-ab7b-63ad856f65b5 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:03.872206 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-d308227d-6b8f-4219-b8db-27185f7da782 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:50:03.887322 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-d308227d-6b8f-4219-b8db-27185f7da782 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 200 len: 1326 microversion: 2.1 time: 0.164092 Aug 24 13:50:03.899885 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 572/1126] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:03 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 1326 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:50:04.007081 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-50a38ec2-9fb1-4bd2-ab7b-63ad856f65b5 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:50:04.020018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-50a38ec2-9fb1-4bd2-ab7b-63ad856f65b5 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41" status: 200 len: 1576 microversion: 2.1 time: 0.241059 Aug 24 13:50:04.020891 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 555/1127] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:03 2022] GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 => generated 1576 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:50:04.911172 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-346c10a0-d140-4967-981e-1e1f9ce9c4bc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:04.911796 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-346c10a0-d140-4967-981e-1e1f9ce9c4bc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:04.919643 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-346c10a0-d140-4967-981e-1e1f9ce9c4bc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:04.920173 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-346c10a0-d140-4967-981e-1e1f9ce9c4bc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:04.920634 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-346c10a0-d140-4967-981e-1e1f9ce9c4bc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:04.921358 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-346c10a0-d140-4967-981e-1e1f9ce9c4bc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:04.921818 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-346c10a0-d140-4967-981e-1e1f9ce9c4bc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:04.922258 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-346c10a0-d140-4967-981e-1e1f9ce9c4bc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:04.938957 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.wsgi [None req-346c10a0-d140-4967-981e-1e1f9ce9c4bc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] HTTP exception thrown: Instance 31b97d61-96c0-459d-83c5-ebd1929f344a could not be found. Aug 24 13:50:04.940768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-346c10a0-d140-4967-981e-1e1f9ce9c4bc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Request method failure captured: Aug 24 13:50:04.940768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a HTTP/1.1 Aug 24 13:50:04.940768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:50:04.940768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:50:04.940768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:50:04.940768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 0 Aug 24 13:50:04.940768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:50:04.940768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:50:04.940768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:50:04.940768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:50:04.940768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBiun8tRbmHUQlTvPsq0siqqif48jOsDdj4o2BD4YZmoAlygMRcO5ZOG2Xy6PhfGG1n2NHjjMXQBmY9DHIN1Lz1pc8opCxWP352OrPSpRmJgqimJUOV5mt4gdxyQ_BKwobp4cAsGPyCUfnIpbfIabYe7pVR9W7JQuxAFYqucb8L0Xgl8 Aug 24 13:50:04.940768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:50:04.940768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:50:04.940768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:50:04.940768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:50:04.940768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:50:04.940768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:50:04.940768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: ca298d9092ad4a9489f1624d62b2ac1d Aug 24 13:50:04.940768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-AttachVolumeTestJSON-433341070 Aug 24 13:50:04.940768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:50:04.940768 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:50:04.943611 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ca298d9092ad4a9489f1624d62b2ac1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ca298d9092ad4a9489f1624d62b2ac1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ca298d9092ad4a9489f1624d62b2ac1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ca298d9092ad4a9489f1624d62b2ac1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:50:04.943611 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-AttachVolumeTestJSON-433341070 Aug 24 13:50:04.943611 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: ca298d9092ad4a9489f1624d62b2ac1d Aug 24 13:50:04.943611 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-AttachVolumeTestJSON-433341070 Aug 24 13:50:04.943611 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-AttachVolumeTestJSON-433341070-project Aug 24 13:50:04.943611 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:50:04.943611 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:50:04.943611 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: 33835c5512df4c80a9b7cb9712a5904f Aug 24 13:50:04.943611 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-AttachVolumeTestJSON-433341070-project Aug 24 13:50:04.943611 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: > Aug 24 13:50:04.943611 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Instance 31b97d61-96c0-459d-83c5-ebd1929f344a could not be found. Aug 24 13:50:04.943611 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'id': '31b97d61-96c0-459d-83c5-ebd1929f344a'} Aug 24 13:50:04.945119 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:50:04.945119 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:50:04.945119 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:50:04.945119 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:50:04.945119 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:50:04.945119 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:50:04.945119 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:50:04.945119 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:50:04.945119 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:50:04.945119 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:50:04.945119 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31b97d61-96c0-459d-83c5-ebd1929f344a could not be found. Aug 24 13:50:04.945119 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:50:04.945119 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:50:04.945119 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:50:04.945119 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:50:04.945119 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:50:04.945119 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:50:04.945119 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:50:04.945119 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:50:04.945119 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:50:04.947422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:50:04.947422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:50:04.947422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:50:04.947422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:50:04.947422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:50:04.947422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:50:04.947422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:50:04.947422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31b97d61-96c0-459d-83c5-ebd1929f344a could not be found. Aug 24 13:50:04.947422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:50:04.947422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:50:04.947422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:50:04.947422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:50:04.947422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:50:04.947422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:50:04.947422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:50:04.947422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:50:04.947422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31b97d61-96c0-459d-83c5-ebd1929f344a could not be found. Aug 24 13:50:04.947422 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:50:04.950190 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-346c10a0-d140-4967-981e-1e1f9ce9c4bc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Returning 404 to user: Instance 31b97d61-96c0-459d-83c5-ebd1929f344a could not be found. {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:50:04.950190 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-346c10a0-d140-4967-981e-1e1f9ce9c4bc tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 404 len: 111 microversion: 2.1 time: 0.035313 Aug 24 13:50:04.950190 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 573/1128] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:04 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:50:04.953384 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-658dea3e-3684-4681-a3c6-0b80a81f2b6a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '.version_select at 0x7f96c21c8430>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:05.042830 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-542e95d3-fcfb-4237-9add-332015e98e77 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:05.043447 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-542e95d3-fcfb-4237-9add-332015e98e77 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:05.049669 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-542e95d3-fcfb-4237-9add-332015e98e77 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:05.050155 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-542e95d3-fcfb-4237-9add-332015e98e77 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:05.050587 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-542e95d3-fcfb-4237-9add-332015e98e77 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:05.051352 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-542e95d3-fcfb-4237-9add-332015e98e77 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:05.051848 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-542e95d3-fcfb-4237-9add-332015e98e77 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:05.052236 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-542e95d3-fcfb-4237-9add-332015e98e77 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:05.064011 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-658dea3e-3684-4681-a3c6-0b80a81f2b6a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1115932680" status: 202 len: 0 microversion: 2.1 time: 0.115651 Aug 24 13:50:05.065027 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 556/1129] 10.222.0.73 () {58 vars in 1221 bytes} [Wed Aug 24 13:50:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1115932680 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 13:50:05.290531 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-542e95d3-fcfb-4237-9add-332015e98e77 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:50:05.299912 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-542e95d3-fcfb-4237-9add-332015e98e77 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41" status: 200 len: 1576 microversion: 2.1 time: 0.261142 Aug 24 13:50:05.300536 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 574/1130] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:05 2022] GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 => generated 1576 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:50:06.324681 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-6e726940-afdf-4978-b334-27698490ea42 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:06.332271 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-6e726940-afdf-4978-b334-27698490ea42 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:06.343549 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6e726940-afdf-4978-b334-27698490ea42 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:06.344986 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-26a2fd6e-c65e-4abe-8da1-e68845f438f2 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Action: 'create', calling method: .version_select at 0x7f96c25305e0>, body: {"keypair": {"name": "tempest-keypair-334586303", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVi/IFRqUVSi2C26kp5QK0kTsixeQToF67clQNn/5sC7tZbb/du+ak7bEAMnrJ0hKqs64A+WLa+TGGl+cNI6T4f7T87jQ+PSvjlzw6YBnQbySIuwHAqCa9Gd9CugBTD/w=="}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:50:06.347455 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6e726940-afdf-4978-b334-27698490ea42 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:06.347933 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6e726940-afdf-4978-b334-27698490ea42 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:06.348819 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6e726940-afdf-4978-b334-27698490ea42 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:06.349196 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6e726940-afdf-4978-b334-27698490ea42 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:06.349910 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-6e726940-afdf-4978-b334-27698490ea42 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:06.361988 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-26a2fd6e-c65e-4abe-8da1-e68845f438f2 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Getting quotas for project ca298d9092ad4a9489f1624d62b2ac1d. Resources: {'key_pairs'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:50:06.366821 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-26a2fd6e-c65e-4abe-8da1-e68845f438f2 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Getting quotas for user 33835c5512df4c80a9b7cb9712a5904f and project ca298d9092ad4a9489f1624d62b2ac1d. Resources: {'key_pairs'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:50:06.498283 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-6e726940-afdf-4978-b334-27698490ea42 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:50:06.506202 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-6e726940-afdf-4978-b334-27698490ea42 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41" status: 200 len: 1457 microversion: 2.1 time: 0.186835 Aug 24 13:50:06.509825 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 557/1131] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:06 2022] GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 => generated 1457 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:50:06.577463 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-26a2fd6e-c65e-4abe-8da1-e68845f438f2 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.237396 Aug 24 13:50:06.577996 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 575/1132] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 13:50:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:50:06.742607 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-f697e836-4b9a-484e-a091-d46a2a8f6eb0 req-fc72c82b-de3d-47c3-9ab7-4ab0b20f0738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6731688e-fae7-4e0d-ba98-11b4aa105a41", "name": "network-vif-deleted", "tag": "6974fab0-e16f-4683-b4b3-3d4218fb55a8"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:50:06.753113 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-f697e836-4b9a-484e-a091-d46a2a8f6eb0 req-fc72c82b-de3d-47c3-9ab7-4ab0b20f0738 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:06.753748 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-f697e836-4b9a-484e-a091-d46a2a8f6eb0 req-fc72c82b-de3d-47c3-9ab7-4ab0b20f0738 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:06.754079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-f697e836-4b9a-484e-a091-d46a2a8f6eb0 req-fc72c82b-de3d-47c3-9ab7-4ab0b20f0738 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:06.765547 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-f697e836-4b9a-484e-a091-d46a2a8f6eb0 req-fc72c82b-de3d-47c3-9ab7-4ab0b20f0738 service nova] Creating event network-vif-deleted:6974fab0-e16f-4683-b4b3-3d4218fb55a8 for instance 6731688e-fae7-4e0d-ba98-11b4aa105a41 on hv-cinder-77957 Aug 24 13:50:06.770447 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-f697e836-4b9a-484e-a091-d46a2a8f6eb0 req-fc72c82b-de3d-47c3-9ab7-4ab0b20f0738 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031672 Aug 24 13:50:06.771133 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 558/1133] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:50:07.528966 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-01d3e85d-1140-4676-b17a-7c51ec808e2f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:07.530110 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-01d3e85d-1140-4676-b17a-7c51ec808e2f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:07.540365 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-01d3e85d-1140-4676-b17a-7c51ec808e2f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:07.540859 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-01d3e85d-1140-4676-b17a-7c51ec808e2f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:07.541649 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-01d3e85d-1140-4676-b17a-7c51ec808e2f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:07.542541 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-01d3e85d-1140-4676-b17a-7c51ec808e2f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:07.543197 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-01d3e85d-1140-4676-b17a-7c51ec808e2f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:07.543628 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-01d3e85d-1140-4676-b17a-7c51ec808e2f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:07.581024 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-01d3e85d-1140-4676-b17a-7c51ec808e2f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:07.581534 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-01d3e85d-1140-4676-b17a-7c51ec808e2f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:07.582025 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-01d3e85d-1140-4676-b17a-7c51ec808e2f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:07.582737 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.objects.instance [None req-01d3e85d-1140-4676-b17a-7c51ec808e2f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lazy-loading 'fault' on Instance uuid 6731688e-fae7-4e0d-ba98-11b4aa105a41 {{(pid=133015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:50:07.628336 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-01d3e85d-1140-4676-b17a-7c51ec808e2f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:50:07.637298 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-01d3e85d-1140-4676-b17a-7c51ec808e2f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41" status: 200 len: 1230 microversion: 2.1 time: 0.113791 Aug 24 13:50:07.637876 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 576/1134] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:07 2022] GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 => generated 1230 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:50:08.664079 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-c3831c50-e3b8-4188-80dc-8b0eeb1143fb tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:08.664815 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-c3831c50-e3b8-4188-80dc-8b0eeb1143fb tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 6731688e-fae7-4e0d-ba98-11b4aa105a41] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:08.671694 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c3831c50-e3b8-4188-80dc-8b0eeb1143fb tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:08.672206 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c3831c50-e3b8-4188-80dc-8b0eeb1143fb tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:08.672673 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c3831c50-e3b8-4188-80dc-8b0eeb1143fb tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:08.673375 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c3831c50-e3b8-4188-80dc-8b0eeb1143fb tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:08.673837 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c3831c50-e3b8-4188-80dc-8b0eeb1143fb tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:08.674264 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c3831c50-e3b8-4188-80dc-8b0eeb1143fb tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:08.688072 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-c3831c50-e3b8-4188-80dc-8b0eeb1143fb tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] HTTP exception thrown: Instance 6731688e-fae7-4e0d-ba98-11b4aa105a41 could not be found. Aug 24 13:50:08.689778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-c3831c50-e3b8-4188-80dc-8b0eeb1143fb tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Request method failure captured: Aug 24 13:50:08.689778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 HTTP/1.1 Aug 24 13:50:08.689778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:50:08.689778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:50:08.689778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:50:08.689778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:50:08.689778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:50:08.689778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:50:08.689778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:50:08.689778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:50:08.689778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBirDMWGCWz1k-wLH4jMxqbOMpcFxpi9pwRC21qoFMgW36uUY1RFRhNX374Cdq6MopCgngEAN-WHOlQvoIss7pZozQzJnAjbr_L0ar2fl9WpR-0laKP7uWrTHuQMFheygufZre0yv_1n7-aoST62xSq8_4T-n4QlskpVqCb82jkHXFi4 Aug 24 13:50:08.689778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:50:08.689778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:50:08.689778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:50:08.689778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:50:08.689778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:50:08.689778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:50:08.689778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 6842f55d3dcc42289b6bfe02ed020dc4 Aug 24 13:50:08.689778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-TestVolumeBootPattern-1955094951 Aug 24 13:50:08.689778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:50:08.689778 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:50:08.691340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6842f55d3dcc42289b6bfe02ed020dc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6842f55d3dcc42289b6bfe02ed020dc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6842f55d3dcc42289b6bfe02ed020dc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6842f55d3dcc42289b6bfe02ed020dc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:50:08.691340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-TestVolumeBootPattern-1955094951 Aug 24 13:50:08.691340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 6842f55d3dcc42289b6bfe02ed020dc4 Aug 24 13:50:08.691340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-TestVolumeBootPattern-1955094951 Aug 24 13:50:08.691340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-TestVolumeBootPattern-1955094951-project Aug 24 13:50:08.691340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:50:08.691340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:50:08.691340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: 98b30f0436864263b2829921f212f8ce Aug 24 13:50:08.691340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-TestVolumeBootPattern-1955094951-project Aug 24 13:50:08.691340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:50:08.691340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Instance 6731688e-fae7-4e0d-ba98-11b4aa105a41 could not be found. Aug 24 13:50:08.691340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': '6731688e-fae7-4e0d-ba98-11b4aa105a41'} Aug 24 13:50:08.692432 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:50:08.692432 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:50:08.692432 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:50:08.692432 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:50:08.692432 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:50:08.692432 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:50:08.692432 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:50:08.692432 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:50:08.692432 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:50:08.692432 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:50:08.692432 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6731688e-fae7-4e0d-ba98-11b4aa105a41 could not be found. Aug 24 13:50:08.692432 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:50:08.692432 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:50:08.692432 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:50:08.692432 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:50:08.692432 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:50:08.692432 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:50:08.692432 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:50:08.692432 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:50:08.692432 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:50:08.693736 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:50:08.693736 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:50:08.693736 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:50:08.693736 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:50:08.693736 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:50:08.693736 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:50:08.693736 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:50:08.693736 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6731688e-fae7-4e0d-ba98-11b4aa105a41 could not be found. Aug 24 13:50:08.693736 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:50:08.693736 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:50:08.693736 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:50:08.693736 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:50:08.693736 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:50:08.693736 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:50:08.693736 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:50:08.693736 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:50:08.693736 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6731688e-fae7-4e0d-ba98-11b4aa105a41 could not be found. Aug 24 13:50:08.693736 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:50:08.694856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-c3831c50-e3b8-4188-80dc-8b0eeb1143fb tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Returning 404 to user: Instance 6731688e-fae7-4e0d-ba98-11b4aa105a41 could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:50:08.694856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-c3831c50-e3b8-4188-80dc-8b0eeb1143fb tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41" status: 404 len: 111 microversion: 2.1 time: 0.032177 Aug 24 13:50:08.694856 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 559/1135] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:08 2022] GET /compute/v2.1/servers/6731688e-fae7-4e0d-ba98-11b4aa105a41 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:50:08.908378 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-0b86f466-8ec4-4067-bfdd-36787d5ce991 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1416035353", "imageRef": "c520113c-3dae-4490-98bb-19fe3a46b66d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f3395214-009c-4aba-9dda-777a5c33eecb"}], "security_groups": [{"name": "tempest-securitygroup--1055355398"}], "key_name": "tempest-keypair-334586303", "user_data": "}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:50:09.018097 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.network.neutron [None req-0b86f466-8ec4-4067-bfdd-36787d5ce991 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] validate_networks() for [('f3395214-009c-4aba-9dda-777a5c33eecb', None, None, None, None, None)] {{(pid=133015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 13:50:09.522003 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-0b86f466-8ec4-4067-bfdd-36787d5ce991 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Flavor limits 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 13:50:09.522003 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-0b86f466-8ec4-4067-bfdd-36787d5ce991 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Image limits 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 13:50:09.522414 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-0b86f466-8ec4-4067-bfdd-36787d5ce991 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Flavor pref 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 13:50:09.522822 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-0b86f466-8ec4-4067-bfdd-36787d5ce991 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Image pref 0:0:0 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 13:50:09.523229 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.virt.hardware [None req-0b86f466-8ec4-4067-bfdd-36787d5ce991 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 13:50:09.532789 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0b86f466-8ec4-4067-bfdd-36787d5ce991 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:09.533271 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0b86f466-8ec4-4067-bfdd-36787d5ce991 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:09.533700 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0b86f466-8ec4-4067-bfdd-36787d5ce991 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:09.534414 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0b86f466-8ec4-4067-bfdd-36787d5ce991 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:09.534863 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0b86f466-8ec4-4067-bfdd-36787d5ce991 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:09.535284 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0b86f466-8ec4-4067-bfdd-36787d5ce991 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:09.554615 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-0b86f466-8ec4-4067-bfdd-36787d5ce991 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Getting quotas for project ca298d9092ad4a9489f1624d62b2ac1d. Resources: {'instances', 'cores', 'ram'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 13:50:09.559623 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.quota [None req-0b86f466-8ec4-4067-bfdd-36787d5ce991 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Getting quotas for user 33835c5512df4c80a9b7cb9712a5904f and project ca298d9092ad4a9489f1624d62b2ac1d. Resources: {'instances', 'cores', 'ram'} {{(pid=133015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 13:50:09.572374 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-0b86f466-8ec4-4067-bfdd-36787d5ce991 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Going to run 1 instances... {{(pid=133015) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 13:50:09.575372 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-0b86f466-8ec4-4067-bfdd-36787d5ce991 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c520113c-3dae-4490-98bb-19fe3a46b66d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 13:50:09.685909 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-0b86f466-8ec4-4067-bfdd-36787d5ce991 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.781880 Aug 24 13:50:09.686823 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 577/1136] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 13:50:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 13:50:09.699105 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-0d3c2cd9-bdf8-4757-a54d-5e2f9e470be2 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:09.700739 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-0d3c2cd9-bdf8-4757-a54d-5e2f9e470be2 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:09.774702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-0d3c2cd9-bdf8-4757-a54d-5e2f9e470be2 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:50:09.784272 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-0d3c2cd9-bdf8-4757-a54d-5e2f9e470be2 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e" status: 200 len: 1237 microversion: 2.1 time: 0.090163 Aug 24 13:50:09.784872 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 560/1137] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:09 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e => generated 1237 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:50:10.814073 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-1e713dfe-6e18-40b4-80a7-854b0755ce84 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:10.814950 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-1e713dfe-6e18-40b4-80a7-854b0755ce84 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:10.822407 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1e713dfe-6e18-40b4-80a7-854b0755ce84 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:10.823626 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1e713dfe-6e18-40b4-80a7-854b0755ce84 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:10.824340 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1e713dfe-6e18-40b4-80a7-854b0755ce84 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:10.825078 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1e713dfe-6e18-40b4-80a7-854b0755ce84 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:10.825535 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1e713dfe-6e18-40b4-80a7-854b0755ce84 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:10.825962 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-1e713dfe-6e18-40b4-80a7-854b0755ce84 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:10.894530 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-1e713dfe-6e18-40b4-80a7-854b0755ce84 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:50:10.903030 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-1e713dfe-6e18-40b4-80a7-854b0755ce84 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e" status: 200 len: 1241 microversion: 2.1 time: 0.096009 Aug 24 13:50:10.903600 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 578/1138] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:10 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:50:11.923723 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-cea74b11-1220-45fc-b5de-e2ad9cc202c9 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:11.925238 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-cea74b11-1220-45fc-b5de-e2ad9cc202c9 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:11.935329 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cea74b11-1220-45fc-b5de-e2ad9cc202c9 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:11.935841 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cea74b11-1220-45fc-b5de-e2ad9cc202c9 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:11.936314 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cea74b11-1220-45fc-b5de-e2ad9cc202c9 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:11.937585 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cea74b11-1220-45fc-b5de-e2ad9cc202c9 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:11.938328 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cea74b11-1220-45fc-b5de-e2ad9cc202c9 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:11.939018 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-cea74b11-1220-45fc-b5de-e2ad9cc202c9 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:12.061258 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-cea74b11-1220-45fc-b5de-e2ad9cc202c9 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:50:12.070426 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-cea74b11-1220-45fc-b5de-e2ad9cc202c9 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e" status: 200 len: 1289 microversion: 2.1 time: 0.150545 Aug 24 13:50:12.071260 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 561/1139] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:11 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e => generated 1289 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:50:12.269703 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-19308e90-a7d8-4a2f-a2a6-b1d16a88650c req-c2429fef-1a88-4aa7-857a-e048c99175c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dba10a5-24cb-4641-914e-7558614f82a6", "tag": "ec946f8f-f434-42c3-90a3-60ce66ddf0c3"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:50:12.273298 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-4b3890d7-5de6-4211-8704-34fcf6e2736b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:12.280636 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-4b3890d7-5de6-4211-8704-34fcf6e2736b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:12.288214 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4b3890d7-5de6-4211-8704-34fcf6e2736b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:12.289060 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4b3890d7-5de6-4211-8704-34fcf6e2736b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:12.289189 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-19308e90-a7d8-4a2f-a2a6-b1d16a88650c req-c2429fef-1a88-4aa7-857a-e048c99175c5 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:12.289590 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-19308e90-a7d8-4a2f-a2a6-b1d16a88650c req-c2429fef-1a88-4aa7-857a-e048c99175c5 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:12.290259 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4b3890d7-5de6-4211-8704-34fcf6e2736b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:12.290632 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-19308e90-a7d8-4a2f-a2a6-b1d16a88650c req-c2429fef-1a88-4aa7-857a-e048c99175c5 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:12.291192 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4b3890d7-5de6-4211-8704-34fcf6e2736b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:12.293033 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4b3890d7-5de6-4211-8704-34fcf6e2736b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:12.293467 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-4b3890d7-5de6-4211-8704-34fcf6e2736b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:12.311520 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-19308e90-a7d8-4a2f-a2a6-b1d16a88650c req-c2429fef-1a88-4aa7-857a-e048c99175c5 service nova] Creating event network-changed:ec946f8f-f434-42c3-90a3-60ce66ddf0c3 for instance 1dba10a5-24cb-4641-914e-7558614f82a6 on hv-cinder-77957 Aug 24 13:50:12.319440 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-19308e90-a7d8-4a2f-a2a6-b1d16a88650c req-c2429fef-1a88-4aa7-857a-e048c99175c5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053316 Aug 24 13:50:12.320262 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 562/1140] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:50:12.335694 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-4b3890d7-5de6-4211-8704-34fcf6e2736b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Going to try to terminate instance {{(pid=133015) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 13:50:12.730093 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-4b3890d7-5de6-4211-8704-34fcf6e2736b tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6" status: 204 len: 0 microversion: 2.1 time: 0.463996 Aug 24 13:50:12.734131 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 579/1141] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:50:12 2022] DELETE /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:50:12.740892 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-5d5b7dc1-9da9-4e4f-a3d6-c16a95d91c53 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:12.741941 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-5d5b7dc1-9da9-4e4f-a3d6-c16a95d91c53 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:12.750153 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5d5b7dc1-9da9-4e4f-a3d6-c16a95d91c53 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:12.750795 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5d5b7dc1-9da9-4e4f-a3d6-c16a95d91c53 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:12.751517 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5d5b7dc1-9da9-4e4f-a3d6-c16a95d91c53 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:12.752500 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5d5b7dc1-9da9-4e4f-a3d6-c16a95d91c53 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:12.753175 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5d5b7dc1-9da9-4e4f-a3d6-c16a95d91c53 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:12.756834 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5d5b7dc1-9da9-4e4f-a3d6-c16a95d91c53 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:12.975615 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-5d5b7dc1-9da9-4e4f-a3d6-c16a95d91c53 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:50:12.984448 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-5d5b7dc1-9da9-4e4f-a3d6-c16a95d91c53 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6" status: 200 len: 1575 microversion: 2.1 time: 0.248233 Aug 24 13:50:12.985277 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 563/1142] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:12 2022] GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 => generated 1575 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:50:13.092728 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-edaa7ad6-b8e2-4ff2-b860-c9bfe6373f40 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:13.093806 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-edaa7ad6-b8e2-4ff2-b860-c9bfe6373f40 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:13.109659 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-edaa7ad6-b8e2-4ff2-b860-c9bfe6373f40 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:13.110601 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-edaa7ad6-b8e2-4ff2-b860-c9bfe6373f40 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:13.111355 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-edaa7ad6-b8e2-4ff2-b860-c9bfe6373f40 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:13.112648 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-edaa7ad6-b8e2-4ff2-b860-c9bfe6373f40 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:13.113285 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-edaa7ad6-b8e2-4ff2-b860-c9bfe6373f40 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:13.114194 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-edaa7ad6-b8e2-4ff2-b860-c9bfe6373f40 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:13.285496 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-edaa7ad6-b8e2-4ff2-b860-c9bfe6373f40 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:50:13.296973 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-edaa7ad6-b8e2-4ff2-b860-c9bfe6373f40 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e" status: 200 len: 1363 microversion: 2.1 time: 0.207860 Aug 24 13:50:13.296973 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 580/1143] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:13 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:50:14.007446 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-1cb6d0e2-3dc6-4cd8-bf8c-0c7821baec9c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:14.008109 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-1cb6d0e2-3dc6-4cd8-bf8c-0c7821baec9c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:14.015460 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1cb6d0e2-3dc6-4cd8-bf8c-0c7821baec9c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:14.015948 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1cb6d0e2-3dc6-4cd8-bf8c-0c7821baec9c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:14.016625 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1cb6d0e2-3dc6-4cd8-bf8c-0c7821baec9c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:14.017536 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1cb6d0e2-3dc6-4cd8-bf8c-0c7821baec9c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:14.018181 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1cb6d0e2-3dc6-4cd8-bf8c-0c7821baec9c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:14.018771 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-1cb6d0e2-3dc6-4cd8-bf8c-0c7821baec9c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:14.167466 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-1cb6d0e2-3dc6-4cd8-bf8c-0c7821baec9c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:50:14.177046 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-1cb6d0e2-3dc6-4cd8-bf8c-0c7821baec9c tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6" status: 200 len: 1575 microversion: 2.1 time: 0.173593 Aug 24 13:50:14.180886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 564/1144] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:14 2022] GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:50:14.318741 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-64af2ab5-0d99-4086-97d3-11a2e905ce2a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:14.319540 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-64af2ab5-0d99-4086-97d3-11a2e905ce2a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:14.327822 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-64af2ab5-0d99-4086-97d3-11a2e905ce2a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:14.327822 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-64af2ab5-0d99-4086-97d3-11a2e905ce2a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:14.328125 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-64af2ab5-0d99-4086-97d3-11a2e905ce2a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:14.328656 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-64af2ab5-0d99-4086-97d3-11a2e905ce2a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:14.329114 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-64af2ab5-0d99-4086-97d3-11a2e905ce2a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:14.329542 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-64af2ab5-0d99-4086-97d3-11a2e905ce2a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:14.472283 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-64af2ab5-0d99-4086-97d3-11a2e905ce2a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:50:14.480443 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-64af2ab5-0d99-4086-97d3-11a2e905ce2a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e" status: 200 len: 1363 microversion: 2.1 time: 0.166309 Aug 24 13:50:14.481027 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 581/1145] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:14 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:50:14.688300 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-cf77219e-f1b7-46b5-8a4e-20bac34fa5d5 req-2631dec8-822a-4180-b701-59cccfece470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6c3f0aa-d151-40dd-bde5-a1ff4507874e", "tag": "5dcc0d20-f388-4c1e-8eab-e5aabbd51dde"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:50:14.701518 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-cf77219e-f1b7-46b5-8a4e-20bac34fa5d5 req-2631dec8-822a-4180-b701-59cccfece470 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:14.701518 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-cf77219e-f1b7-46b5-8a4e-20bac34fa5d5 req-2631dec8-822a-4180-b701-59cccfece470 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:14.701886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-cf77219e-f1b7-46b5-8a4e-20bac34fa5d5 req-2631dec8-822a-4180-b701-59cccfece470 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:14.713907 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-cf77219e-f1b7-46b5-8a4e-20bac34fa5d5 req-2631dec8-822a-4180-b701-59cccfece470 service nova] Creating event network-changed:5dcc0d20-f388-4c1e-8eab-e5aabbd51dde for instance b6c3f0aa-d151-40dd-bde5-a1ff4507874e on hv-cinder-77957 Aug 24 13:50:14.718945 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-cf77219e-f1b7-46b5-8a4e-20bac34fa5d5 req-2631dec8-822a-4180-b701-59cccfece470 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034648 Aug 24 13:50:14.719730 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 565/1146] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:50:15.096335 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-bb882af7-45ae-4918-a45c-2a40dcc1d45e req-2f9e486e-4b4e-4414-bf38-e82f1ecf2988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dba10a5-24cb-4641-914e-7558614f82a6", "name": "network-vif-deleted", "tag": "ec946f8f-f434-42c3-90a3-60ce66ddf0c3"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:50:15.107748 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-bb882af7-45ae-4918-a45c-2a40dcc1d45e req-2f9e486e-4b4e-4414-bf38-e82f1ecf2988 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:15.108293 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-bb882af7-45ae-4918-a45c-2a40dcc1d45e req-2f9e486e-4b4e-4414-bf38-e82f1ecf2988 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:15.108622 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-bb882af7-45ae-4918-a45c-2a40dcc1d45e req-2f9e486e-4b4e-4414-bf38-e82f1ecf2988 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:15.120999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-bb882af7-45ae-4918-a45c-2a40dcc1d45e req-2f9e486e-4b4e-4414-bf38-e82f1ecf2988 service nova] Creating event network-vif-deleted:ec946f8f-f434-42c3-90a3-60ce66ddf0c3 for instance 1dba10a5-24cb-4641-914e-7558614f82a6 on hv-cinder-77957 Aug 24 13:50:15.126161 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-bb882af7-45ae-4918-a45c-2a40dcc1d45e req-2f9e486e-4b4e-4414-bf38-e82f1ecf2988 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033562 Aug 24 13:50:15.126761 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 582/1147] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:50:15.200525 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-5c0fc56f-485c-4a90-ac15-5279a60fc8ae tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:15.201140 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-5c0fc56f-485c-4a90-ac15-5279a60fc8ae tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:15.207381 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5c0fc56f-485c-4a90-ac15-5279a60fc8ae tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:15.210566 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5c0fc56f-485c-4a90-ac15-5279a60fc8ae tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:15.210566 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5c0fc56f-485c-4a90-ac15-5279a60fc8ae tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:15.210566 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5c0fc56f-485c-4a90-ac15-5279a60fc8ae tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:15.210566 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5c0fc56f-485c-4a90-ac15-5279a60fc8ae tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:15.211188 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5c0fc56f-485c-4a90-ac15-5279a60fc8ae tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:15.282255 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-5c0fc56f-485c-4a90-ac15-5279a60fc8ae tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:50:15.289067 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-5c0fc56f-485c-4a90-ac15-5279a60fc8ae tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6" status: 200 len: 1389 microversion: 2.1 time: 0.093943 Aug 24 13:50:15.289644 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 566/1148] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:15 2022] GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:50:15.507879 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-5a766755-bdaf-4769-82bd-fb7ccff3a997 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:15.510978 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-5a766755-bdaf-4769-82bd-fb7ccff3a997 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:15.520136 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5a766755-bdaf-4769-82bd-fb7ccff3a997 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:15.520656 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5a766755-bdaf-4769-82bd-fb7ccff3a997 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:15.521086 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5a766755-bdaf-4769-82bd-fb7ccff3a997 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:15.521770 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5a766755-bdaf-4769-82bd-fb7ccff3a997 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:15.522219 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5a766755-bdaf-4769-82bd-fb7ccff3a997 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:15.522633 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-5a766755-bdaf-4769-82bd-fb7ccff3a997 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:15.909687 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-5a766755-bdaf-4769-82bd-fb7ccff3a997 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:50:15.917424 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-5a766755-bdaf-4769-82bd-fb7ccff3a997 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e" status: 200 len: 1363 microversion: 2.1 time: 0.419664 Aug 24 13:50:15.917990 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 583/1149] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:15 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e => generated 1363 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:50:16.311968 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-76fa933f-d140-4a10-aed4-71ca4f8d1a3f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:16.312779 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-76fa933f-d140-4a10-aed4-71ca4f8d1a3f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:16.319801 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-76fa933f-d140-4a10-aed4-71ca4f8d1a3f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:16.320350 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-76fa933f-d140-4a10-aed4-71ca4f8d1a3f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:16.320799 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-76fa933f-d140-4a10-aed4-71ca4f8d1a3f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:16.321507 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-76fa933f-d140-4a10-aed4-71ca4f8d1a3f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:16.321971 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-76fa933f-d140-4a10-aed4-71ca4f8d1a3f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:16.323853 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-76fa933f-d140-4a10-aed4-71ca4f8d1a3f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:16.388916 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-76fa933f-d140-4a10-aed4-71ca4f8d1a3f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b30f0436864263b2829921f212f8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6842f55d3dcc42289b6bfe02ed020dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:50:16.396824 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-76fa933f-d140-4a10-aed4-71ca4f8d1a3f tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6" status: 200 len: 1224 microversion: 2.1 time: 0.088805 Aug 24 13:50:16.397394 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 567/1150] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:16 2022] GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:50:16.938491 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-0f788855-f302-40a8-a36f-993c8576348f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:16.939148 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-0f788855-f302-40a8-a36f-993c8576348f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:16.945926 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0f788855-f302-40a8-a36f-993c8576348f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:16.948389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0f788855-f302-40a8-a36f-993c8576348f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:16.948389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0f788855-f302-40a8-a36f-993c8576348f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:16.948389 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0f788855-f302-40a8-a36f-993c8576348f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:16.948876 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0f788855-f302-40a8-a36f-993c8576348f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:16.948977 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-0f788855-f302-40a8-a36f-993c8576348f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:16.953350 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:50:17.085427 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-0f788855-f302-40a8-a36f-993c8576348f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:50:17.093496 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-0f788855-f302-40a8-a36f-993c8576348f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e" status: 200 len: 1363 microversion: 2.1 time: 0.159067 Aug 24 13:50:17.105147 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 584/1151] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:16 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:50:17.419645 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-456f5d9b-348f-4afd-a004-36163bbcd47d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:17.420319 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-456f5d9b-348f-4afd-a004-36163bbcd47d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: 1dba10a5-24cb-4641-914e-7558614f82a6] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:17.427131 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-456f5d9b-348f-4afd-a004-36163bbcd47d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:17.429116 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-456f5d9b-348f-4afd-a004-36163bbcd47d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:17.429116 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-456f5d9b-348f-4afd-a004-36163bbcd47d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:17.429116 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-456f5d9b-348f-4afd-a004-36163bbcd47d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:17.429451 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-456f5d9b-348f-4afd-a004-36163bbcd47d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:17.429726 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-456f5d9b-348f-4afd-a004-36163bbcd47d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:17.444613 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-456f5d9b-348f-4afd-a004-36163bbcd47d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] HTTP exception thrown: Instance 1dba10a5-24cb-4641-914e-7558614f82a6 could not be found. Aug 24 13:50:17.446324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-456f5d9b-348f-4afd-a004-36163bbcd47d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Request method failure captured: Aug 24 13:50:17.446324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 HTTP/1.1 Aug 24 13:50:17.446324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:50:17.446324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:50:17.446324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:50:17.446324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:50:17.446324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:50:17.446324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:50:17.446324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:50:17.446324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:50:17.446324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBirDMWGCWz1k-wLH4jMxqbOMpcFxpi9pwRC21qoFMgW36uUY1RFRhNX374Cdq6MopCgngEAN-WHOlQvoIss7pZozQzJnAjbr_L0ar2fl9WpR-0laKP7uWrTHuQMFheygufZre0yv_1n7-aoST62xSq8_4T-n4QlskpVqCb82jkHXFi4 Aug 24 13:50:17.446324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:50:17.446324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:50:17.446324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:50:17.446324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:50:17.446324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:50:17.446324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:50:17.446324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 6842f55d3dcc42289b6bfe02ed020dc4 Aug 24 13:50:17.446324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-TestVolumeBootPattern-1955094951 Aug 24 13:50:17.446324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:50:17.446324 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:50:17.448016 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6842f55d3dcc42289b6bfe02ed020dc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6842f55d3dcc42289b6bfe02ed020dc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6842f55d3dcc42289b6bfe02ed020dc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6842f55d3dcc42289b6bfe02ed020dc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:50:17.448016 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-TestVolumeBootPattern-1955094951 Aug 24 13:50:17.448016 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 6842f55d3dcc42289b6bfe02ed020dc4 Aug 24 13:50:17.448016 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-TestVolumeBootPattern-1955094951 Aug 24 13:50:17.448016 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-TestVolumeBootPattern-1955094951-project Aug 24 13:50:17.448016 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:50:17.448016 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:50:17.448016 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: 98b30f0436864263b2829921f212f8ce Aug 24 13:50:17.448016 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-TestVolumeBootPattern-1955094951-project Aug 24 13:50:17.448016 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:50:17.448016 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Instance 1dba10a5-24cb-4641-914e-7558614f82a6 could not be found. Aug 24 13:50:17.448016 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': '1dba10a5-24cb-4641-914e-7558614f82a6'} Aug 24 13:50:17.449096 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:50:17.449096 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:50:17.449096 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:50:17.449096 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:50:17.449096 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:50:17.449096 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:50:17.449096 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:50:17.449096 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:50:17.449096 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:50:17.449096 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:50:17.449096 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dba10a5-24cb-4641-914e-7558614f82a6 could not be found. Aug 24 13:50:17.449096 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:50:17.449096 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:50:17.449096 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:50:17.449096 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:50:17.449096 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:50:17.449096 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:50:17.449096 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:50:17.449096 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:50:17.449096 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:50:17.450689 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:50:17.450689 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:50:17.450689 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:50:17.450689 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:50:17.450689 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:50:17.450689 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:50:17.450689 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:50:17.450689 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dba10a5-24cb-4641-914e-7558614f82a6 could not be found. Aug 24 13:50:17.450689 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:50:17.450689 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:50:17.450689 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:50:17.450689 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:50:17.450689 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:50:17.450689 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:50:17.450689 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:50:17.450689 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:50:17.450689 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dba10a5-24cb-4641-914e-7558614f82a6 could not be found. Aug 24 13:50:17.450689 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:50:17.452109 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-456f5d9b-348f-4afd-a004-36163bbcd47d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Returning 404 to user: Instance 1dba10a5-24cb-4641-914e-7558614f82a6 could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:50:17.452109 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-456f5d9b-348f-4afd-a004-36163bbcd47d tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6" status: 404 len: 111 microversion: 2.1 time: 0.033709 Aug 24 13:50:17.452109 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 568/1152] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:17 2022] GET /compute/v2.1/servers/1dba10a5-24cb-4641-914e-7558614f82a6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:50:17.979244 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-168ff252-9bee-46f7-aac8-083a4b3cef15 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:17.979899 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-168ff252-9bee-46f7-aac8-083a4b3cef15 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:17.987078 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-168ff252-9bee-46f7-aac8-083a4b3cef15 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:17.987626 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-168ff252-9bee-46f7-aac8-083a4b3cef15 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:17.988069 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-168ff252-9bee-46f7-aac8-083a4b3cef15 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:17.988804 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-168ff252-9bee-46f7-aac8-083a4b3cef15 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:17.989260 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-168ff252-9bee-46f7-aac8-083a4b3cef15 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:17.989685 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-168ff252-9bee-46f7-aac8-083a4b3cef15 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:18.004233 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.wsgi [None req-168ff252-9bee-46f7-aac8-083a4b3cef15 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] HTTP exception thrown: Instance d89846c9-96d3-4b1b-bba0-bc5d89c6bbde could not be found. Aug 24 13:50:18.005964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-168ff252-9bee-46f7-aac8-083a4b3cef15 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Request method failure captured: Aug 24 13:50:18.005964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: DELETE /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde HTTP/1.1 Aug 24 13:50:18.005964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:50:18.005964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:50:18.005964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:50:18.005964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 0 Aug 24 13:50:18.005964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:50:18.005964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:50:18.005964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:50:18.005964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:50:18.005964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBirDMWGCWz1k-wLH4jMxqbOMpcFxpi9pwRC21qoFMgW36uUY1RFRhNX374Cdq6MopCgngEAN-WHOlQvoIss7pZozQzJnAjbr_L0ar2fl9WpR-0laKP7uWrTHuQMFheygufZre0yv_1n7-aoST62xSq8_4T-n4QlskpVqCb82jkHXFi4 Aug 24 13:50:18.005964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:50:18.005964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:50:18.005964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:50:18.005964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:50:18.005964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:50:18.005964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:50:18.005964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: 6842f55d3dcc42289b6bfe02ed020dc4 Aug 24 13:50:18.005964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-TestVolumeBootPattern-1955094951 Aug 24 13:50:18.005964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:50:18.005964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:50:18.007580 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6842f55d3dcc42289b6bfe02ed020dc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6842f55d3dcc42289b6bfe02ed020dc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6842f55d3dcc42289b6bfe02ed020dc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6842f55d3dcc42289b6bfe02ed020dc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:50:18.007580 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-TestVolumeBootPattern-1955094951 Aug 24 13:50:18.007580 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: 6842f55d3dcc42289b6bfe02ed020dc4 Aug 24 13:50:18.007580 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-TestVolumeBootPattern-1955094951 Aug 24 13:50:18.007580 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-TestVolumeBootPattern-1955094951-project Aug 24 13:50:18.007580 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:50:18.007580 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:50:18.007580 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: 98b30f0436864263b2829921f212f8ce Aug 24 13:50:18.007580 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-TestVolumeBootPattern-1955094951-project Aug 24 13:50:18.007580 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: > Aug 24 13:50:18.007580 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Instance d89846c9-96d3-4b1b-bba0-bc5d89c6bbde could not be found. Aug 24 13:50:18.007580 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'id': 'd89846c9-96d3-4b1b-bba0-bc5d89c6bbde'} Aug 24 13:50:18.008521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:50:18.008521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:50:18.008521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:50:18.008521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:50:18.008521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:50:18.008521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:50:18.008521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:50:18.008521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:50:18.008521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:50:18.008521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:50:18.008521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d89846c9-96d3-4b1b-bba0-bc5d89c6bbde could not be found. Aug 24 13:50:18.008521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:50:18.008521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:50:18.008521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:50:18.008521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:50:18.008521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:50:18.008521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:50:18.008521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:50:18.008521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:50:18.008521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:50:18.010607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:50:18.010607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 13:50:18.010607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 13:50:18.010607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 13:50:18.010607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 13:50:18.010607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:50:18.010607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:50:18.010607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:50:18.010607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:50:18.010607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d89846c9-96d3-4b1b-bba0-bc5d89c6bbde could not be found. Aug 24 13:50:18.010607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:50:18.010607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:50:18.010607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:50:18.010607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:50:18.010607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:50:18.010607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:50:18.010607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:50:18.010607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:50:18.010607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d89846c9-96d3-4b1b-bba0-bc5d89c6bbde could not be found. Aug 24 13:50:18.010607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:50:18.012091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-168ff252-9bee-46f7-aac8-083a4b3cef15 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Returning 404 to user: Instance d89846c9-96d3-4b1b-bba0-bc5d89c6bbde could not be found. {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:50:18.012091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-168ff252-9bee-46f7-aac8-083a4b3cef15 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "DELETE /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 404 len: 111 microversion: 2.1 time: 0.033803 Aug 24 13:50:18.012091 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 585/1153] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:50:17 2022] DELETE /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:50:18.016820 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-8860a473-a35c-4fbd-96ac-56b956737a67 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:18.017475 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-8860a473-a35c-4fbd-96ac-56b956737a67 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] [instance: d89846c9-96d3-4b1b-bba0-bc5d89c6bbde] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:18.023632 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8860a473-a35c-4fbd-96ac-56b956737a67 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:18.024130 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8860a473-a35c-4fbd-96ac-56b956737a67 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:18.024615 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8860a473-a35c-4fbd-96ac-56b956737a67 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:18.025330 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8860a473-a35c-4fbd-96ac-56b956737a67 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:18.026952 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8860a473-a35c-4fbd-96ac-56b956737a67 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:18.027429 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-8860a473-a35c-4fbd-96ac-56b956737a67 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:18.042958 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-8860a473-a35c-4fbd-96ac-56b956737a67 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] HTTP exception thrown: Instance d89846c9-96d3-4b1b-bba0-bc5d89c6bbde could not be found. Aug 24 13:50:18.044567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-8860a473-a35c-4fbd-96ac-56b956737a67 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Request method failure captured: Aug 24 13:50:18.044567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde HTTP/1.1 Aug 24 13:50:18.044567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:50:18.044567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:50:18.044567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:50:18.044567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:50:18.044567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:50:18.044567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:50:18.044567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:50:18.044567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:50:18.044567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBirDMWGCWz1k-wLH4jMxqbOMpcFxpi9pwRC21qoFMgW36uUY1RFRhNX374Cdq6MopCgngEAN-WHOlQvoIss7pZozQzJnAjbr_L0ar2fl9WpR-0laKP7uWrTHuQMFheygufZre0yv_1n7-aoST62xSq8_4T-n4QlskpVqCb82jkHXFi4 Aug 24 13:50:18.044567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:50:18.044567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:50:18.044567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:50:18.044567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:50:18.044567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:50:18.044567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:50:18.044567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: 6842f55d3dcc42289b6bfe02ed020dc4 Aug 24 13:50:18.044567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-TestVolumeBootPattern-1955094951 Aug 24 13:50:18.044567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:50:18.044567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:50:18.046146 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6842f55d3dcc42289b6bfe02ed020dc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6842f55d3dcc42289b6bfe02ed020dc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6842f55d3dcc42289b6bfe02ed020dc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6842f55d3dcc42289b6bfe02ed020dc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:50:18.046146 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-TestVolumeBootPattern-1955094951 Aug 24 13:50:18.046146 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: 6842f55d3dcc42289b6bfe02ed020dc4 Aug 24 13:50:18.046146 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-TestVolumeBootPattern-1955094951 Aug 24 13:50:18.046146 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-TestVolumeBootPattern-1955094951-project Aug 24 13:50:18.046146 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:50:18.046146 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:50:18.046146 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: 98b30f0436864263b2829921f212f8ce Aug 24 13:50:18.046146 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-TestVolumeBootPattern-1955094951-project Aug 24 13:50:18.046146 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:50:18.046146 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Instance d89846c9-96d3-4b1b-bba0-bc5d89c6bbde could not be found. Aug 24 13:50:18.046146 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': 'd89846c9-96d3-4b1b-bba0-bc5d89c6bbde'} Aug 24 13:50:18.047822 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:50:18.047822 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:50:18.047822 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:50:18.047822 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:50:18.047822 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:50:18.047822 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:50:18.047822 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:50:18.047822 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:50:18.047822 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:50:18.047822 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:50:18.047822 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d89846c9-96d3-4b1b-bba0-bc5d89c6bbde could not be found. Aug 24 13:50:18.047822 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:50:18.047822 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:50:18.047822 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:50:18.047822 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:50:18.047822 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:50:18.047822 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:50:18.047822 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:50:18.047822 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:50:18.047822 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:50:18.049964 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:50:18.049964 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:50:18.049964 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:50:18.049964 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:50:18.049964 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:50:18.049964 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:50:18.049964 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:50:18.049964 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d89846c9-96d3-4b1b-bba0-bc5d89c6bbde could not be found. Aug 24 13:50:18.049964 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:50:18.049964 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:50:18.049964 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:50:18.049964 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:50:18.049964 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:50:18.049964 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:50:18.049964 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:50:18.049964 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:50:18.049964 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d89846c9-96d3-4b1b-bba0-bc5d89c6bbde could not be found. Aug 24 13:50:18.049964 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:50:18.051322 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-8860a473-a35c-4fbd-96ac-56b956737a67 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Returning 404 to user: Instance d89846c9-96d3-4b1b-bba0-bc5d89c6bbde could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:50:18.051322 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-8860a473-a35c-4fbd-96ac-56b956737a67 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde" status: 404 len: 111 microversion: 2.1 time: 0.033146 Aug 24 13:50:18.051322 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 569/1154] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:18 2022] GET /compute/v2.1/servers/d89846c9-96d3-4b1b-bba0-bc5d89c6bbde => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:50:18.114989 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-c7be2a51-4479-4d68-947d-a1870988d9e3 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:18.115646 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-c7be2a51-4479-4d68-947d-a1870988d9e3 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:18.121587 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c7be2a51-4479-4d68-947d-a1870988d9e3 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:18.122076 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c7be2a51-4479-4d68-947d-a1870988d9e3 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:18.122513 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c7be2a51-4479-4d68-947d-a1870988d9e3 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:18.123207 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c7be2a51-4479-4d68-947d-a1870988d9e3 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:18.123665 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c7be2a51-4479-4d68-947d-a1870988d9e3 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:18.124197 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c7be2a51-4479-4d68-947d-a1870988d9e3 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:18.261046 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-c7be2a51-4479-4d68-947d-a1870988d9e3 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:50:18.268903 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-c7be2a51-4479-4d68-947d-a1870988d9e3 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e" status: 200 len: 1363 microversion: 2.1 time: 0.158257 Aug 24 13:50:18.269457 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 586/1155] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:18 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:50:19.290904 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-35fd79e5-1207-4611-9ed9-8aa6c7b086cd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:19.292733 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-35fd79e5-1207-4611-9ed9-8aa6c7b086cd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:19.299462 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-35fd79e5-1207-4611-9ed9-8aa6c7b086cd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:19.300391 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-35fd79e5-1207-4611-9ed9-8aa6c7b086cd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:19.300540 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-35fd79e5-1207-4611-9ed9-8aa6c7b086cd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:19.301351 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-35fd79e5-1207-4611-9ed9-8aa6c7b086cd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:19.301842 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-35fd79e5-1207-4611-9ed9-8aa6c7b086cd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:19.302327 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-35fd79e5-1207-4611-9ed9-8aa6c7b086cd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:19.452132 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-35fd79e5-1207-4611-9ed9-8aa6c7b086cd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:50:19.464760 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-35fd79e5-1207-4611-9ed9-8aa6c7b086cd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e" status: 200 len: 1363 microversion: 2.1 time: 0.177550 Aug 24 13:50:19.465946 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 570/1156] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:19 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:50:19.541243 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=2 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:50:19.566745 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell0:SELECT=10 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:50:19.666959 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-d60e6a01-149d-46dd-a405-f190b881f251 req-b73a88e6-8deb-4452-a6d7-78c6f516f923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6c3f0aa-d151-40dd-bde5-a1ff4507874e", "name": "network-vif-plugged", "status": "completed", "tag": "5dcc0d20-f388-4c1e-8eab-e5aabbd51dde"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:50:19.677286 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-d60e6a01-149d-46dd-a405-f190b881f251 req-b73a88e6-8deb-4452-a6d7-78c6f516f923 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:19.677814 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-d60e6a01-149d-46dd-a405-f190b881f251 req-b73a88e6-8deb-4452-a6d7-78c6f516f923 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:19.683155 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-d60e6a01-149d-46dd-a405-f190b881f251 req-b73a88e6-8deb-4452-a6d7-78c6f516f923 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:19.692116 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-d60e6a01-149d-46dd-a405-f190b881f251 req-b73a88e6-8deb-4452-a6d7-78c6f516f923 service nova] Creating event network-vif-plugged:5dcc0d20-f388-4c1e-8eab-e5aabbd51dde for instance b6c3f0aa-d151-40dd-bde5-a1ff4507874e on hv-cinder-77957 Aug 24 13:50:19.698217 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-d60e6a01-149d-46dd-a405-f190b881f251 req-b73a88e6-8deb-4452-a6d7-78c6f516f923 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.241060 Aug 24 13:50:19.699249 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 587/1157] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:50:19.731702 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-ccb8fee6-d02d-4817-ba70-3c365e18c463 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] Calling method '.version_select at 0x7f96c21b7e50>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:19.780986 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell0:SELECT=2 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:50:19.878021 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-ccb8fee6-d02d-4817-ba70-3c365e18c463 tempest-TestVolumeBootPattern-1955094951 tempest-TestVolumeBootPattern-1955094951-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-797259511" status: 202 len: 0 microversion: 2.1 time: 0.151709 Aug 24 13:50:19.878525 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 571/1158] 10.222.0.73 () {58 vars in 1260 bytes} [Wed Aug 24 13:50:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-797259511 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:50:20.494345 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-39214209-1d90-4261-97d2-348c159c4ad7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:20.494345 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-39214209-1d90-4261-97d2-348c159c4ad7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:20.496113 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-39214209-1d90-4261-97d2-348c159c4ad7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:20.496113 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-39214209-1d90-4261-97d2-348c159c4ad7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:20.496431 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-39214209-1d90-4261-97d2-348c159c4ad7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:20.497123 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-39214209-1d90-4261-97d2-348c159c4ad7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:20.497582 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-39214209-1d90-4261-97d2-348c159c4ad7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:20.497999 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-39214209-1d90-4261-97d2-348c159c4ad7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:20.637683 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-39214209-1d90-4261-97d2-348c159c4ad7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:50:20.646053 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-39214209-1d90-4261-97d2-348c159c4ad7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e" status: 200 len: 1363 microversion: 2.1 time: 0.162713 Aug 24 13:50:20.646654 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 588/1159] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:20 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:50:21.668866 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-dfa6e53d-9db4-4d31-82a1-1e94daf3e0e1 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:21.669490 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-dfa6e53d-9db4-4d31-82a1-1e94daf3e0e1 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:21.676274 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dfa6e53d-9db4-4d31-82a1-1e94daf3e0e1 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:21.676733 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dfa6e53d-9db4-4d31-82a1-1e94daf3e0e1 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:21.677179 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dfa6e53d-9db4-4d31-82a1-1e94daf3e0e1 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:21.677915 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dfa6e53d-9db4-4d31-82a1-1e94daf3e0e1 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:21.678373 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dfa6e53d-9db4-4d31-82a1-1e94daf3e0e1 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:21.678802 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-dfa6e53d-9db4-4d31-82a1-1e94daf3e0e1 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:21.699140 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:50:21.816208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-dfa6e53d-9db4-4d31-82a1-1e94daf3e0e1 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:50:21.824972 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-dfa6e53d-9db4-4d31-82a1-1e94daf3e0e1 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e" status: 200 len: 1549 microversion: 2.1 time: 0.161505 Aug 24 13:50:21.825555 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 572/1160] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:50:21 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:50:21.846802 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-9102311a-4832-4d05-8be7-35359ffee4ac tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:21.852896 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-9102311a-4832-4d05-8be7-35359ffee4ac tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:21.854489 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9102311a-4832-4d05-8be7-35359ffee4ac tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:21.855157 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9102311a-4832-4d05-8be7-35359ffee4ac tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:21.855597 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9102311a-4832-4d05-8be7-35359ffee4ac tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:21.856373 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9102311a-4832-4d05-8be7-35359ffee4ac tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:21.856840 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9102311a-4832-4d05-8be7-35359ffee4ac tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:21.857271 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9102311a-4832-4d05-8be7-35359ffee4ac tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:21.939383 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-9102311a-4832-4d05-8be7-35359ffee4ac tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096680 Aug 24 13:50:21.940003 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 589/1161] 10.222.0.73 () {58 vars in 1275 bytes} [Wed Aug 24 13:50:21 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:50:23.207174 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [req-89b0b9b0-5888-4f59-8656-23046b6541d0 req-fdc1a021-ab41-436d-a6f5-378a1c05c428 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6c3f0aa-d151-40dd-bde5-a1ff4507874e", "tag": "5dcc0d20-f388-4c1e-8eab-e5aabbd51dde"}]} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:50:23.221210 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-89b0b9b0-5888-4f59-8656-23046b6541d0 req-fdc1a021-ab41-436d-a6f5-378a1c05c428 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:23.221805 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-89b0b9b0-5888-4f59-8656-23046b6541d0 req-fdc1a021-ab41-436d-a6f5-378a1c05c428 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:23.222314 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [req-89b0b9b0-5888-4f59-8656-23046b6541d0 req-fdc1a021-ab41-436d-a6f5-378a1c05c428 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:23.236312 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.compute.server_external_events [req-89b0b9b0-5888-4f59-8656-23046b6541d0 req-fdc1a021-ab41-436d-a6f5-378a1c05c428 service nova] Creating event network-changed:5dcc0d20-f388-4c1e-8eab-e5aabbd51dde for instance b6c3f0aa-d151-40dd-bde5-a1ff4507874e on hv-cinder-77957 Aug 24 13:50:23.241697 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [req-89b0b9b0-5888-4f59-8656-23046b6541d0 req-fdc1a021-ab41-436d-a6f5-378a1c05c428 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039793 Aug 24 13:50:23.242770 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 573/1162] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 13:50:58.565012 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:50:58.565780 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG dbcounter [-] [133015] Writing DB stats nova_cell1:SELECT=24 {{(pid=133015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:50:58.569944 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-2f74da4c-65fd-418a-8a6b-481c5c3652f7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:50:58.570440 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-2f74da4c-65fd-418a-8a6b-481c5c3652f7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:50:58.577033 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f74da4c-65fd-418a-8a6b-481c5c3652f7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:58.580885 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f74da4c-65fd-418a-8a6b-481c5c3652f7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:58.580885 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f74da4c-65fd-418a-8a6b-481c5c3652f7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:58.580885 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f74da4c-65fd-418a-8a6b-481c5c3652f7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:50:58.580885 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f74da4c-65fd-418a-8a6b-481c5c3652f7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:50:58.581305 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-2f74da4c-65fd-418a-8a6b-481c5c3652f7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:50:58.604408 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-2f74da4c-65fd-418a-8a6b-481c5c3652f7 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/ips" status: 200 len: 146 microversion: 2.1 time: 0.041005 Aug 24 13:50:58.605075 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 590/1163] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 13:50:58 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:51:00.194255 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-f8c69d7a-06f9-4b67-aee6-c0d7a55b5b0f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26e88d8a-d674-4a4b-a532-5725be41a2b1"}} {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:51:00.196696 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-f8c69d7a-06f9-4b67-aee6-c0d7a55b5b0f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:51:00.198882 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:51:00.199553 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=4 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:51:00.204623 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f8c69d7a-06f9-4b67-aee6-c0d7a55b5b0f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:00.205127 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f8c69d7a-06f9-4b67-aee6-c0d7a55b5b0f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:00.205567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f8c69d7a-06f9-4b67-aee6-c0d7a55b5b0f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:00.206259 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f8c69d7a-06f9-4b67-aee6-c0d7a55b5b0f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:00.206718 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f8c69d7a-06f9-4b67-aee6-c0d7a55b5b0f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:00.207142 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-f8c69d7a-06f9-4b67-aee6-c0d7a55b5b0f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:00.875133 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-f8c69d7a-06f9-4b67-aee6-c0d7a55b5b0f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "POST /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.685359 Aug 24 13:51:00.875745 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 574/1164] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 13:51:00 2022] POST /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/os-volume_attachments => generated 194 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:51:08.401274 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-ae71214a-63b2-4360-98ce-c2cdc9dd9f8d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:51:08.403521 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-ae71214a-63b2-4360-98ce-c2cdc9dd9f8d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:51:08.411122 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ae71214a-63b2-4360-98ce-c2cdc9dd9f8d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:08.411607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ae71214a-63b2-4360-98ce-c2cdc9dd9f8d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:08.412041 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ae71214a-63b2-4360-98ce-c2cdc9dd9f8d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:08.412771 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ae71214a-63b2-4360-98ce-c2cdc9dd9f8d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:08.413249 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ae71214a-63b2-4360-98ce-c2cdc9dd9f8d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:08.419640 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-ae71214a-63b2-4360-98ce-c2cdc9dd9f8d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:08.444534 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-ae71214a-63b2-4360-98ce-c2cdc9dd9f8d tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047744 Aug 24 13:51:08.445090 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 591/1165] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:51:08 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:51:08.456930 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-a08577f4-1ecf-46d8-a2d2-858cef2f620f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:51:08.457522 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-a08577f4-1ecf-46d8-a2d2-858cef2f620f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:51:08.463708 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a08577f4-1ecf-46d8-a2d2-858cef2f620f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:08.464225 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a08577f4-1ecf-46d8-a2d2-858cef2f620f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:08.464673 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a08577f4-1ecf-46d8-a2d2-858cef2f620f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:08.465366 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a08577f4-1ecf-46d8-a2d2-858cef2f620f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:08.465829 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a08577f4-1ecf-46d8-a2d2-858cef2f620f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:08.466257 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-a08577f4-1ecf-46d8-a2d2-858cef2f620f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:08.495807 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-a08577f4-1ecf-46d8-a2d2-858cef2f620f tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/os-volume_attachments/26e88d8a-d674-4a4b-a532-5725be41a2b1" status: 200 len: 194 microversion: 2.1 time: 0.043785 Aug 24 13:51:08.496422 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 575/1166] 10.222.0.73 () {58 vars in 1413 bytes} [Wed Aug 24 13:51:08 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/os-volume_attachments/26e88d8a-d674-4a4b-a532-5725be41a2b1 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:51:10.137031 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-63206cf4-092a-4006-840f-2756a3a770bd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2bfbb2ba-385b-4230-a8a8-7a7d25710d25"}} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:51:10.139339 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-63206cf4-092a-4006-840f-2756a3a770bd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:51:10.146785 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-63206cf4-092a-4006-840f-2756a3a770bd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:10.147274 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-63206cf4-092a-4006-840f-2756a3a770bd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:10.147711 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-63206cf4-092a-4006-840f-2756a3a770bd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:10.148452 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-63206cf4-092a-4006-840f-2756a3a770bd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:10.148909 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-63206cf4-092a-4006-840f-2756a3a770bd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:10.149337 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-63206cf4-092a-4006-840f-2756a3a770bd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:10.959744 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-63206cf4-092a-4006-840f-2756a3a770bd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "POST /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.826561 Aug 24 13:51:10.960402 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 592/1167] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 13:51:10 2022] POST /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/os-volume_attachments => generated 194 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:51:18.678328 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-57a60528-751d-4987-af06-23b49efe6840 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:51:18.680825 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-57a60528-751d-4987-af06-23b49efe6840 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:51:18.683368 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_api:SELECT=4 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:51:18.684034 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG dbcounter [-] [133014] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:51:18.688805 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-57a60528-751d-4987-af06-23b49efe6840 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:18.689316 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-57a60528-751d-4987-af06-23b49efe6840 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:18.694719 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-57a60528-751d-4987-af06-23b49efe6840 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:18.694719 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-57a60528-751d-4987-af06-23b49efe6840 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:18.694719 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-57a60528-751d-4987-af06-23b49efe6840 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:18.694719 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-57a60528-751d-4987-af06-23b49efe6840 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:18.721897 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-57a60528-751d-4987-af06-23b49efe6840 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047583 Aug 24 13:51:18.724747 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 576/1168] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:51:18 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:51:18.867010 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-9ae08223-2818-4085-9893-60c482ce0ae0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:51:18.867555 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-9ae08223-2818-4085-9893-60c482ce0ae0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:51:18.873820 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9ae08223-2818-4085-9893-60c482ce0ae0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:18.874306 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9ae08223-2818-4085-9893-60c482ce0ae0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:18.874742 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9ae08223-2818-4085-9893-60c482ce0ae0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:18.875438 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9ae08223-2818-4085-9893-60c482ce0ae0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:18.875890 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9ae08223-2818-4085-9893-60c482ce0ae0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:18.876361 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-9ae08223-2818-4085-9893-60c482ce0ae0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:18.906394 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-9ae08223-2818-4085-9893-60c482ce0ae0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/os-volume_attachments/26e88d8a-d674-4a4b-a532-5725be41a2b1" status: 200 len: 194 microversion: 2.1 time: 0.044518 Aug 24 13:51:18.906991 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 593/1169] 10.222.0.73 () {58 vars in 1413 bytes} [Wed Aug 24 13:51:18 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/os-volume_attachments/26e88d8a-d674-4a4b-a532-5725be41a2b1 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:51:18.918158 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-026c07c3-43e5-45ac-9645-0f526d53ae01 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:51:18.918661 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-026c07c3-43e5-45ac-9645-0f526d53ae01 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:51:18.926002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-026c07c3-43e5-45ac-9645-0f526d53ae01 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:18.926538 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-026c07c3-43e5-45ac-9645-0f526d53ae01 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:18.926979 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-026c07c3-43e5-45ac-9645-0f526d53ae01 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:18.927723 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-026c07c3-43e5-45ac-9645-0f526d53ae01 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:18.928283 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-026c07c3-43e5-45ac-9645-0f526d53ae01 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:18.938593 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-026c07c3-43e5-45ac-9645-0f526d53ae01 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:19.011155 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.objects.instance [None req-026c07c3-43e5-45ac-9645-0f526d53ae01 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lazy-loading 'services' on Instance uuid b6c3f0aa-d151-40dd-bde5-a1ff4507874e {{(pid=133014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:51:19.241995 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-026c07c3-43e5-45ac-9645-0f526d53ae01 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/os-volume_attachments/26e88d8a-d674-4a4b-a532-5725be41a2b1" status: 202 len: 0 microversion: 2.1 time: 0.327896 Aug 24 13:51:19.242586 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 577/1170] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 13:51:18 2022] DELETE /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/os-volume_attachments/26e88d8a-d674-4a4b-a532-5725be41a2b1 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:51:21.416629 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-c780671f-6055-4ad6-9005-fda707f310f0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:51:21.417181 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-c780671f-6055-4ad6-9005-fda707f310f0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:51:21.424359 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c780671f-6055-4ad6-9005-fda707f310f0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:21.424848 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c780671f-6055-4ad6-9005-fda707f310f0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:21.425283 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c780671f-6055-4ad6-9005-fda707f310f0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:21.425980 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c780671f-6055-4ad6-9005-fda707f310f0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:21.426435 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c780671f-6055-4ad6-9005-fda707f310f0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:21.426916 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-c780671f-6055-4ad6-9005-fda707f310f0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:21.456445 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-c780671f-6055-4ad6-9005-fda707f310f0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/os-volume_attachments/2bfbb2ba-385b-4230-a8a8-7a7d25710d25" status: 200 len: 194 microversion: 2.1 time: 0.043818 Aug 24 13:51:21.457038 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 594/1171] 10.222.0.73 () {58 vars in 1413 bytes} [Wed Aug 24 13:51:21 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/os-volume_attachments/2bfbb2ba-385b-4230-a8a8-7a7d25710d25 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:51:21.468537 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-5947d37f-d040-4279-be3a-39a78e2d2f35 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:51:21.469132 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-5947d37f-d040-4279-be3a-39a78e2d2f35 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:51:21.475421 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5947d37f-d040-4279-be3a-39a78e2d2f35 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:21.475909 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5947d37f-d040-4279-be3a-39a78e2d2f35 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:21.476376 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5947d37f-d040-4279-be3a-39a78e2d2f35 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:21.477078 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5947d37f-d040-4279-be3a-39a78e2d2f35 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:21.477539 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5947d37f-d040-4279-be3a-39a78e2d2f35 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:21.477968 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-5947d37f-d040-4279-be3a-39a78e2d2f35 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:21.557664 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.objects.instance [None req-5947d37f-d040-4279-be3a-39a78e2d2f35 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lazy-loading 'services' on Instance uuid b6c3f0aa-d151-40dd-bde5-a1ff4507874e {{(pid=133014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:51:21.726162 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-5947d37f-d040-4279-be3a-39a78e2d2f35 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/os-volume_attachments/2bfbb2ba-385b-4230-a8a8-7a7d25710d25" status: 202 len: 0 microversion: 2.1 time: 0.262223 Aug 24 13:51:21.726793 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 578/1172] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 13:51:21 2022] DELETE /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/os-volume_attachments/2bfbb2ba-385b-4230-a8a8-7a7d25710d25 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:51:22.906158 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-950dba98-6136-4ad8-abee-d029bc81ac87 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:51:22.908708 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-950dba98-6136-4ad8-abee-d029bc81ac87 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:51:22.915199 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-950dba98-6136-4ad8-abee-d029bc81ac87 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:22.915682 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-950dba98-6136-4ad8-abee-d029bc81ac87 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:22.916115 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-950dba98-6136-4ad8-abee-d029bc81ac87 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:22.916827 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-950dba98-6136-4ad8-abee-d029bc81ac87 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:22.917282 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-950dba98-6136-4ad8-abee-d029bc81ac87 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:22.917706 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-950dba98-6136-4ad8-abee-d029bc81ac87 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:22.947663 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-950dba98-6136-4ad8-abee-d029bc81ac87 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045508 Aug 24 13:51:22.948241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 595/1173] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:51:22 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 13:51:23.061811 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-c765888c-037e-4552-a3a2-50f42958f889 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:51:23.064783 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-c765888c-037e-4552-a3a2-50f42958f889 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:51:23.071783 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c765888c-037e-4552-a3a2-50f42958f889 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:23.072320 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c765888c-037e-4552-a3a2-50f42958f889 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:23.072766 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c765888c-037e-4552-a3a2-50f42958f889 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:23.073464 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c765888c-037e-4552-a3a2-50f42958f889 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:23.073924 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c765888c-037e-4552-a3a2-50f42958f889 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:23.074354 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-c765888c-037e-4552-a3a2-50f42958f889 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:23.103004 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-c765888c-037e-4552-a3a2-50f42958f889 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045506 Aug 24 13:51:23.103553 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 579/1174] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 13:51:23 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 13:51:23.164500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-f0f42a95-8d96-4dd7-9dd1-8ee4b91de940 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:51:23.164994 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-f0f42a95-8d96-4dd7-9dd1-8ee4b91de940 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:51:23.170858 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f0f42a95-8d96-4dd7-9dd1-8ee4b91de940 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:23.171370 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f0f42a95-8d96-4dd7-9dd1-8ee4b91de940 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:23.171799 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f0f42a95-8d96-4dd7-9dd1-8ee4b91de940 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:23.172511 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f0f42a95-8d96-4dd7-9dd1-8ee4b91de940 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:23.172957 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f0f42a95-8d96-4dd7-9dd1-8ee4b91de940 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:23.173964 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-f0f42a95-8d96-4dd7-9dd1-8ee4b91de940 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:23.198959 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-f0f42a95-8d96-4dd7-9dd1-8ee4b91de940 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Going to try to terminate instance {{(pid=133015) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 13:51:23.469776 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-f0f42a95-8d96-4dd7-9dd1-8ee4b91de940 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e" status: 204 len: 0 microversion: 2.1 time: 0.308729 Aug 24 13:51:23.470899 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 596/1175] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:51:23 2022] DELETE /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 13:51:23.479264 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-245d7f7e-f360-4bc5-9201-f755a6105a42 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:51:23.479846 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-245d7f7e-f360-4bc5-9201-f755a6105a42 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:51:23.486480 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-245d7f7e-f360-4bc5-9201-f755a6105a42 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:23.486961 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-245d7f7e-f360-4bc5-9201-f755a6105a42 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:23.487400 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-245d7f7e-f360-4bc5-9201-f755a6105a42 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:23.488089 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-245d7f7e-f360-4bc5-9201-f755a6105a42 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:23.488571 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-245d7f7e-f360-4bc5-9201-f755a6105a42 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:23.489001 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-245d7f7e-f360-4bc5-9201-f755a6105a42 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:23.623044 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-245d7f7e-f360-4bc5-9201-f755a6105a42 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:51:23.631086 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-245d7f7e-f360-4bc5-9201-f755a6105a42 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e" status: 200 len: 1674 microversion: 2.1 time: 0.155813 Aug 24 13:51:23.632488 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 580/1176] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:51:23 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:51:24.654024 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-b8dc9eb3-e8af-4fcb-a03a-8c8c96744008 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:51:24.654725 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-b8dc9eb3-e8af-4fcb-a03a-8c8c96744008 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:51:24.661713 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b8dc9eb3-e8af-4fcb-a03a-8c8c96744008 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:24.662186 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b8dc9eb3-e8af-4fcb-a03a-8c8c96744008 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:24.662613 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b8dc9eb3-e8af-4fcb-a03a-8c8c96744008 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:24.663289 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b8dc9eb3-e8af-4fcb-a03a-8c8c96744008 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:24.663736 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b8dc9eb3-e8af-4fcb-a03a-8c8c96744008 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:24.664151 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-b8dc9eb3-e8af-4fcb-a03a-8c8c96744008 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:24.794160 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.policy [None req-b8dc9eb3-e8af-4fcb-a03a-8c8c96744008 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:51:24.802458 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-b8dc9eb3-e8af-4fcb-a03a-8c8c96744008 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e" status: 200 len: 1674 microversion: 2.1 time: 0.152703 Aug 24 13:51:24.803017 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 597/1177] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:51:24 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:51:25.823815 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-92018953-a223-4784-9a1b-f677400c281a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:51:25.824386 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-92018953-a223-4784-9a1b-f677400c281a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:51:25.831490 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-92018953-a223-4784-9a1b-f677400c281a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:25.831984 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-92018953-a223-4784-9a1b-f677400c281a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:25.832469 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-92018953-a223-4784-9a1b-f677400c281a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:25.833177 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-92018953-a223-4784-9a1b-f677400c281a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:25.833632 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-92018953-a223-4784-9a1b-f677400c281a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:25.834052 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-92018953-a223-4784-9a1b-f677400c281a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:25.968841 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-92018953-a223-4784-9a1b-f677400c281a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:51:25.976907 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-92018953-a223-4784-9a1b-f677400c281a tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e" status: 200 len: 1674 microversion: 2.1 time: 0.157027 Aug 24 13:51:25.978540 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 581/1178] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:51:25 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 13:51:26.438050 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [req-bc896d66-2586-481a-828d-b93869e5ab1a req-ec81ece5-a48f-4284-acfe-514ff808d3f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6c3f0aa-d151-40dd-bde5-a1ff4507874e", "name": "network-vif-deleted", "tag": "5dcc0d20-f388-4c1e-8eab-e5aabbd51dde"}]} {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 13:51:26.449725 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-bc896d66-2586-481a-828d-b93869e5ab1a req-ec81ece5-a48f-4284-acfe-514ff808d3f6 service nova] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:26.449725 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-bc896d66-2586-481a-828d-b93869e5ab1a req-ec81ece5-a48f-4284-acfe-514ff808d3f6 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:26.449989 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [req-bc896d66-2586-481a-828d-b93869e5ab1a req-ec81ece5-a48f-4284-acfe-514ff808d3f6 service nova] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:26.461739 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.compute.server_external_events [req-bc896d66-2586-481a-828d-b93869e5ab1a req-ec81ece5-a48f-4284-acfe-514ff808d3f6 service nova] Creating event network-vif-deleted:5dcc0d20-f388-4c1e-8eab-e5aabbd51dde for instance b6c3f0aa-d151-40dd-bde5-a1ff4507874e on hv-cinder-77957 Aug 24 13:51:26.467168 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [req-bc896d66-2586-481a-828d-b93869e5ab1a req-ec81ece5-a48f-4284-acfe-514ff808d3f6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032831 Aug 24 13:51:26.468295 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 598/1179] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 13:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 13:51:26.999192 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-40b48887-e8b8-499e-8d5e-b485a4690d6c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:51:26.999916 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-40b48887-e8b8-499e-8d5e-b485a4690d6c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:51:27.007077 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-40b48887-e8b8-499e-8d5e-b485a4690d6c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:27.007567 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-40b48887-e8b8-499e-8d5e-b485a4690d6c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:27.008004 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-40b48887-e8b8-499e-8d5e-b485a4690d6c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:27.008741 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-40b48887-e8b8-499e-8d5e-b485a4690d6c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:27.009204 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-40b48887-e8b8-499e-8d5e-b485a4690d6c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:27.009758 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-40b48887-e8b8-499e-8d5e-b485a4690d6c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:27.042132 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-40b48887-e8b8-499e-8d5e-b485a4690d6c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:27.042621 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-40b48887-e8b8-499e-8d5e-b485a4690d6c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:27.043060 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-40b48887-e8b8-499e-8d5e-b485a4690d6c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:27.043511 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.objects.instance [None req-40b48887-e8b8-499e-8d5e-b485a4690d6c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lazy-loading 'fault' on Instance uuid b6c3f0aa-d151-40dd-bde5-a1ff4507874e {{(pid=133014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 13:51:27.086473 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.policy [None req-40b48887-e8b8-499e-8d5e-b485a4690d6c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33835c5512df4c80a9b7cb9712a5904f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca298d9092ad4a9489f1624d62b2ac1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133014) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 13:51:27.095678 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-40b48887-e8b8-499e-8d5e-b485a4690d6c tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e" status: 200 len: 1327 microversion: 2.1 time: 0.099706 Aug 24 13:51:27.096695 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 582/1180] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:51:26 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 13:51:28.118694 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-3619f9d4-a307-4bce-a98c-a450477039a0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:51:28.119395 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-3619f9d4-a307-4bce-a98c-a450477039a0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:51:28.125564 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3619f9d4-a307-4bce-a98c-a450477039a0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:28.126039 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3619f9d4-a307-4bce-a98c-a450477039a0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:28.126627 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3619f9d4-a307-4bce-a98c-a450477039a0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:28.127314 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3619f9d4-a307-4bce-a98c-a450477039a0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:28.127769 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3619f9d4-a307-4bce-a98c-a450477039a0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:28.128207 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3619f9d4-a307-4bce-a98c-a450477039a0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:28.141395 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.wsgi [None req-3619f9d4-a307-4bce-a98c-a450477039a0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] HTTP exception thrown: Instance b6c3f0aa-d151-40dd-bde5-a1ff4507874e could not be found. Aug 24 13:51:28.143318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-3619f9d4-a307-4bce-a98c-a450477039a0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Request method failure captured: Aug 24 13:51:28.143318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e HTTP/1.1 Aug 24 13:51:28.143318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:51:28.143318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:51:28.143318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:51:28.143318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 0 Aug 24 13:51:28.143318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:51:28.143318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:51:28.143318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:51:28.143318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:51:28.143318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBiun8tRbmHUQlTvPsq0siqqif48jOsDdj4o2BD4YZmoAlygMRcO5ZOG2Xy6PhfGG1n2NHjjMXQBmY9DHIN1Lz1pc8opCxWP352OrPSpRmJgqimJUOV5mt4gdxyQ_BKwobp4cAsGPyCUfnIpbfIabYe7pVR9W7JQuxAFYqucb8L0Xgl8 Aug 24 13:51:28.143318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:51:28.143318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:51:28.143318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:51:28.143318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:51:28.143318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:51:28.143318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:51:28.143318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: ca298d9092ad4a9489f1624d62b2ac1d Aug 24 13:51:28.143318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-AttachVolumeTestJSON-433341070 Aug 24 13:51:28.143318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:51:28.143318 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:51:28.145040 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ca298d9092ad4a9489f1624d62b2ac1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ca298d9092ad4a9489f1624d62b2ac1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ca298d9092ad4a9489f1624d62b2ac1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ca298d9092ad4a9489f1624d62b2ac1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:51:28.145040 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-AttachVolumeTestJSON-433341070 Aug 24 13:51:28.145040 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: ca298d9092ad4a9489f1624d62b2ac1d Aug 24 13:51:28.145040 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-AttachVolumeTestJSON-433341070 Aug 24 13:51:28.145040 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-AttachVolumeTestJSON-433341070-project Aug 24 13:51:28.145040 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:51:28.145040 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:51:28.145040 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: 33835c5512df4c80a9b7cb9712a5904f Aug 24 13:51:28.145040 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-AttachVolumeTestJSON-433341070-project Aug 24 13:51:28.145040 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: > Aug 24 13:51:28.145040 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Instance b6c3f0aa-d151-40dd-bde5-a1ff4507874e could not be found. Aug 24 13:51:28.145040 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'id': 'b6c3f0aa-d151-40dd-bde5-a1ff4507874e'} Aug 24 13:51:28.146130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:51:28.146130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:51:28.146130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:51:28.146130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:51:28.146130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:51:28.146130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:51:28.146130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:51:28.146130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:51:28.146130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:51:28.146130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:51:28.146130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6c3f0aa-d151-40dd-bde5-a1ff4507874e could not be found. Aug 24 13:51:28.146130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:51:28.146130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:51:28.146130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:51:28.146130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:51:28.146130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:51:28.146130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:51:28.146130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:51:28.146130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:51:28.146130 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:51:28.147803 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:51:28.147803 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:51:28.147803 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:51:28.147803 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:51:28.147803 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:51:28.147803 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:51:28.147803 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:51:28.147803 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6c3f0aa-d151-40dd-bde5-a1ff4507874e could not be found. Aug 24 13:51:28.147803 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:51:28.147803 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:51:28.147803 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:51:28.147803 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:51:28.147803 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:51:28.147803 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:51:28.147803 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:51:28.147803 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:51:28.147803 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6c3f0aa-d151-40dd-bde5-a1ff4507874e could not be found. Aug 24 13:51:28.147803 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:51:28.149614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-3619f9d4-a307-4bce-a98c-a450477039a0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Returning 404 to user: Instance b6c3f0aa-d151-40dd-bde5-a1ff4507874e could not be found. {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:51:28.149614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-3619f9d4-a307-4bce-a98c-a450477039a0 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e" status: 404 len: 111 microversion: 2.1 time: 0.030797 Aug 24 13:51:28.149614 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 599/1181] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:51:28 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:51:28.153649 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-b5c5537b-85ef-4869-af1e-f26f132b8942 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '.version_select at 0x7f96c221f9d0>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:51:28.230756 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-b5c5537b-85ef-4869-af1e-f26f132b8942 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-334586303" status: 202 len: 0 microversion: 2.1 time: 0.080901 Aug 24 13:51:28.231339 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 583/1182] 10.222.0.73 () {58 vars in 1218 bytes} [Wed Aug 24 13:51:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-334586303 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 13:51:31.673216 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-78846eb4-94ed-4cdb-bec2-b15aedd64edd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:51:31.673723 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-78846eb4-94ed-4cdb-bec2-b15aedd64edd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:51:31.681211 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-78846eb4-94ed-4cdb-bec2-b15aedd64edd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:31.681694 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-78846eb4-94ed-4cdb-bec2-b15aedd64edd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:31.682136 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-78846eb4-94ed-4cdb-bec2-b15aedd64edd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:31.682820 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-78846eb4-94ed-4cdb-bec2-b15aedd64edd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:31.683273 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-78846eb4-94ed-4cdb-bec2-b15aedd64edd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:31.683696 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-78846eb4-94ed-4cdb-bec2-b15aedd64edd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:31.698458 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.wsgi [None req-78846eb4-94ed-4cdb-bec2-b15aedd64edd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] HTTP exception thrown: Instance b6c3f0aa-d151-40dd-bde5-a1ff4507874e could not be found. Aug 24 13:51:31.700002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-78846eb4-94ed-4cdb-bec2-b15aedd64edd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Request method failure captured: Aug 24 13:51:31.700002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: DELETE /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e HTTP/1.1 Aug 24 13:51:31.700002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:51:31.700002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:51:31.700002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:51:31.700002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 0 Aug 24 13:51:31.700002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:51:31.700002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:51:31.700002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:51:31.700002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:51:31.700002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBiun8tRbmHUQlTvPsq0siqqif48jOsDdj4o2BD4YZmoAlygMRcO5ZOG2Xy6PhfGG1n2NHjjMXQBmY9DHIN1Lz1pc8opCxWP352OrPSpRmJgqimJUOV5mt4gdxyQ_BKwobp4cAsGPyCUfnIpbfIabYe7pVR9W7JQuxAFYqucb8L0Xgl8 Aug 24 13:51:31.700002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:51:31.700002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:51:31.700002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:51:31.700002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:51:31.700002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:51:31.700002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:51:31.700002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: ca298d9092ad4a9489f1624d62b2ac1d Aug 24 13:51:31.700002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-AttachVolumeTestJSON-433341070 Aug 24 13:51:31.700002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:51:31.700002 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:51:31.701658 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ca298d9092ad4a9489f1624d62b2ac1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ca298d9092ad4a9489f1624d62b2ac1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ca298d9092ad4a9489f1624d62b2ac1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ca298d9092ad4a9489f1624d62b2ac1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:51:31.701658 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-AttachVolumeTestJSON-433341070 Aug 24 13:51:31.701658 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: ca298d9092ad4a9489f1624d62b2ac1d Aug 24 13:51:31.701658 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-AttachVolumeTestJSON-433341070 Aug 24 13:51:31.701658 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-AttachVolumeTestJSON-433341070-project Aug 24 13:51:31.701658 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:51:31.701658 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:51:31.701658 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: 33835c5512df4c80a9b7cb9712a5904f Aug 24 13:51:31.701658 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-AttachVolumeTestJSON-433341070-project Aug 24 13:51:31.701658 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: > Aug 24 13:51:31.701658 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Instance b6c3f0aa-d151-40dd-bde5-a1ff4507874e could not be found. Aug 24 13:51:31.701658 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'id': 'b6c3f0aa-d151-40dd-bde5-a1ff4507874e'} Aug 24 13:51:31.702568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:51:31.702568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:51:31.702568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:51:31.702568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:51:31.702568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:51:31.702568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:51:31.702568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:51:31.702568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:51:31.702568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:51:31.702568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:51:31.702568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6c3f0aa-d151-40dd-bde5-a1ff4507874e could not be found. Aug 24 13:51:31.702568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:51:31.702568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:51:31.702568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:51:31.702568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:51:31.702568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:51:31.702568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:51:31.702568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:51:31.702568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:51:31.702568 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:51:31.704140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:51:31.704140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 13:51:31.704140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 13:51:31.704140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 13:51:31.704140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 13:51:31.704140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:51:31.704140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:51:31.704140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:51:31.704140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:51:31.704140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6c3f0aa-d151-40dd-bde5-a1ff4507874e could not be found. Aug 24 13:51:31.704140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:51:31.704140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:51:31.704140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:51:31.704140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:51:31.704140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:51:31.704140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:51:31.704140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:51:31.704140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:51:31.704140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6c3f0aa-d151-40dd-bde5-a1ff4507874e could not be found. Aug 24 13:51:31.704140 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:51:31.705607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-78846eb4-94ed-4cdb-bec2-b15aedd64edd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Returning 404 to user: Instance b6c3f0aa-d151-40dd-bde5-a1ff4507874e could not be found. {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:51:31.705607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-78846eb4-94ed-4cdb-bec2-b15aedd64edd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e" status: 404 len: 111 microversion: 2.1 time: 0.032119 Aug 24 13:51:31.705607 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 600/1183] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:51:31 2022] DELETE /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:51:31.709993 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-24343d32-21e3-47bb-afa4-956c6f743b46 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:51:31.710600 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-24343d32-21e3-47bb-afa4-956c6f743b46 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: b6c3f0aa-d151-40dd-bde5-a1ff4507874e] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:51:31.717699 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-24343d32-21e3-47bb-afa4-956c6f743b46 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:31.718177 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-24343d32-21e3-47bb-afa4-956c6f743b46 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:31.718607 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-24343d32-21e3-47bb-afa4-956c6f743b46 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:31.719290 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-24343d32-21e3-47bb-afa4-956c6f743b46 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:31.719742 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-24343d32-21e3-47bb-afa4-956c6f743b46 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:31.720159 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-24343d32-21e3-47bb-afa4-956c6f743b46 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:31.733257 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-24343d32-21e3-47bb-afa4-956c6f743b46 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] HTTP exception thrown: Instance b6c3f0aa-d151-40dd-bde5-a1ff4507874e could not be found. Aug 24 13:51:31.734886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-24343d32-21e3-47bb-afa4-956c6f743b46 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Request method failure captured: Aug 24 13:51:31.734886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e HTTP/1.1 Aug 24 13:51:31.734886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:51:31.734886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:51:31.734886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:51:31.734886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:51:31.734886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:51:31.734886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:51:31.734886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:51:31.734886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:51:31.734886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBiun8tRbmHUQlTvPsq0siqqif48jOsDdj4o2BD4YZmoAlygMRcO5ZOG2Xy6PhfGG1n2NHjjMXQBmY9DHIN1Lz1pc8opCxWP352OrPSpRmJgqimJUOV5mt4gdxyQ_BKwobp4cAsGPyCUfnIpbfIabYe7pVR9W7JQuxAFYqucb8L0Xgl8 Aug 24 13:51:31.734886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:51:31.734886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:51:31.734886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:51:31.734886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:51:31.734886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:51:31.734886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:51:31.734886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: ca298d9092ad4a9489f1624d62b2ac1d Aug 24 13:51:31.734886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-AttachVolumeTestJSON-433341070 Aug 24 13:51:31.734886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:51:31.734886 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:51:31.736548 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ca298d9092ad4a9489f1624d62b2ac1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ca298d9092ad4a9489f1624d62b2ac1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ca298d9092ad4a9489f1624d62b2ac1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ca298d9092ad4a9489f1624d62b2ac1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:51:31.736548 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-AttachVolumeTestJSON-433341070 Aug 24 13:51:31.736548 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: ca298d9092ad4a9489f1624d62b2ac1d Aug 24 13:51:31.736548 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-AttachVolumeTestJSON-433341070 Aug 24 13:51:31.736548 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-AttachVolumeTestJSON-433341070-project Aug 24 13:51:31.736548 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:51:31.736548 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:51:31.736548 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: 33835c5512df4c80a9b7cb9712a5904f Aug 24 13:51:31.736548 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-AttachVolumeTestJSON-433341070-project Aug 24 13:51:31.736548 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:51:31.736548 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Instance b6c3f0aa-d151-40dd-bde5-a1ff4507874e could not be found. Aug 24 13:51:31.736548 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': 'b6c3f0aa-d151-40dd-bde5-a1ff4507874e'} Aug 24 13:51:31.738007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:51:31.738007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:51:31.738007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:51:31.738007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:51:31.738007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:51:31.738007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:51:31.738007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:51:31.738007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:51:31.738007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:51:31.738007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:51:31.738007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6c3f0aa-d151-40dd-bde5-a1ff4507874e could not be found. Aug 24 13:51:31.738007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:51:31.738007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:51:31.738007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:51:31.738007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:51:31.738007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:51:31.738007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:51:31.738007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:51:31.738007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:51:31.738007 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:51:31.739531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:51:31.739531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:51:31.739531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:51:31.739531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:51:31.739531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:51:31.739531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:51:31.739531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:51:31.739531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6c3f0aa-d151-40dd-bde5-a1ff4507874e could not be found. Aug 24 13:51:31.739531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:51:31.739531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:51:31.739531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:51:31.739531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:51:31.739531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:51:31.739531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:51:31.739531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:51:31.739531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:51:31.739531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6c3f0aa-d151-40dd-bde5-a1ff4507874e could not be found. Aug 24 13:51:31.739531 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:51:31.741237 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-24343d32-21e3-47bb-afa4-956c6f743b46 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Returning 404 to user: Instance b6c3f0aa-d151-40dd-bde5-a1ff4507874e could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:51:31.741237 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-24343d32-21e3-47bb-afa4-956c6f743b46 tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e" status: 404 len: 111 microversion: 2.1 time: 0.030291 Aug 24 13:51:31.741237 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 584/1184] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:51:31 2022] GET /compute/v2.1/servers/b6c3f0aa-d151-40dd-bde5-a1ff4507874e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:51:33.037276 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-3f0aae95-dbb9-4b6c-8e3e-443ea0e1242b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:51:33.037815 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.compute.api [None req-3f0aae95-dbb9-4b6c-8e3e-443ea0e1242b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133015) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:51:33.044266 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3f0aae95-dbb9-4b6c-8e3e-443ea0e1242b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:33.044745 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3f0aae95-dbb9-4b6c-8e3e-443ea0e1242b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:33.045180 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3f0aae95-dbb9-4b6c-8e3e-443ea0e1242b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:33.045863 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3f0aae95-dbb9-4b6c-8e3e-443ea0e1242b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:33.046309 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3f0aae95-dbb9-4b6c-8e3e-443ea0e1242b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:33.046731 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG oslo_concurrency.lockutils [None req-3f0aae95-dbb9-4b6c-8e3e-443ea0e1242b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:33.060968 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.wsgi [None req-3f0aae95-dbb9-4b6c-8e3e-443ea0e1242b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] HTTP exception thrown: Instance 31b97d61-96c0-459d-83c5-ebd1929f344a could not be found. Aug 24 13:51:33.062500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-3f0aae95-dbb9-4b6c-8e3e-443ea0e1242b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Request method failure captured: Aug 24 13:51:33.062500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: request: DELETE /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a HTTP/1.1 Aug 24 13:51:33.062500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept: application/json Aug 24 13:51:33.062500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Accept-Encoding: identity Aug 24 13:51:33.062500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Connection: close Aug 24 13:51:33.062500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Length: 0 Aug 24 13:51:33.062500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Content-Type: application/json Aug 24 13:51:33.062500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Host: 10.222.0.73 Aug 24 13:51:33.062500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Openstack-System-Scope: None Aug 24 13:51:33.062500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: User-Agent: python-urllib3/1.26.11 Aug 24 13:51:33.062500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Auth-Token: gAAAAABjBiun8tRbmHUQlTvPsq0siqqif48jOsDdj4o2BD4YZmoAlygMRcO5ZOG2Xy6PhfGG1n2NHjjMXQBmY9DHIN1Lz1pc8opCxWP352OrPSpRmJgqimJUOV5mt4gdxyQ_BKwobp4cAsGPyCUfnIpbfIabYe7pVR9W7JQuxAFYqucb8L0Xgl8 Aug 24 13:51:33.062500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Id: None Aug 24 13:51:33.062500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Domain-Name: None Aug 24 13:51:33.062500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Identity-Status: Confirmed Aug 24 13:51:33.062500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Is-Admin-Project: True Aug 24 13:51:33.062500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Id: default Aug 24 13:51:33.062500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Domain-Name: Default Aug 24 13:51:33.062500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Id: ca298d9092ad4a9489f1624d62b2ac1d Aug 24 13:51:33.062500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Project-Name: tempest-AttachVolumeTestJSON-433341070 Aug 24 13:51:33.062500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Role: member,reader Aug 24 13:51:33.062500 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Roles: member,reader Aug 24 13:51:33.064095 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ca298d9092ad4a9489f1624d62b2ac1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ca298d9092ad4a9489f1624d62b2ac1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ca298d9092ad4a9489f1624d62b2ac1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ca298d9092ad4a9489f1624d62b2ac1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:51:33.064095 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant: tempest-AttachVolumeTestJSON-433341070 Aug 24 13:51:33.064095 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Id: ca298d9092ad4a9489f1624d62b2ac1d Aug 24 13:51:33.064095 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-Tenant-Name: tempest-AttachVolumeTestJSON-433341070 Aug 24 13:51:33.064095 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User: tempest-AttachVolumeTestJSON-433341070-project Aug 24 13:51:33.064095 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Id: default Aug 24 13:51:33.064095 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Domain-Name: Default Aug 24 13:51:33.064095 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Id: 33835c5512df4c80a9b7cb9712a5904f Aug 24 13:51:33.064095 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: X-User-Name: tempest-AttachVolumeTestJSON-433341070-project Aug 24 13:51:33.064095 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: method: > Aug 24 13:51:33.064095 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: exception: Instance 31b97d61-96c0-459d-83c5-ebd1929f344a could not be found. Aug 24 13:51:33.064095 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: action_args: {'id': '31b97d61-96c0-459d-83c5-ebd1929f344a'} Aug 24 13:51:33.066241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: {{(pid=133015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:51:33.066241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:51:33.066241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:51:33.066241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:51:33.066241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:51:33.066241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:51:33.066241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:51:33.066241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:51:33.066241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:51:33.066241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:51:33.066241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31b97d61-96c0-459d-83c5-ebd1929f344a could not be found. Aug 24 13:51:33.066241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:51:33.066241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:51:33.066241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:51:33.066241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:51:33.066241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:51:33.066241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:51:33.066241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:51:33.066241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:51:33.066241 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:51:33.067586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:51:33.067586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 13:51:33.067586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 13:51:33.067586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 13:51:33.067586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 13:51:33.067586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:51:33.067586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:51:33.067586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:51:33.067586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:51:33.067586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31b97d61-96c0-459d-83c5-ebd1929f344a could not be found. Aug 24 13:51:33.067586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:51:33.067586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:51:33.067586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:51:33.067586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:51:33.067586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:51:33.067586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:51:33.067586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:51:33.067586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:51:33.067586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31b97d61-96c0-459d-83c5-ebd1929f344a could not be found. Aug 24 13:51:33.067586 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: ERROR nova.api.openstack.wsgi Aug 24 13:51:33.069196 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: DEBUG nova.api.openstack.wsgi [None req-3f0aae95-dbb9-4b6c-8e3e-443ea0e1242b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Returning 404 to user: Instance 31b97d61-96c0-459d-83c5-ebd1929f344a could not be found. {{(pid=133015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:51:33.069196 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO nova.api.openstack.requestlog [None req-3f0aae95-dbb9-4b6c-8e3e-443ea0e1242b tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "DELETE /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 404 len: 111 microversion: 2.1 time: 0.030730 Aug 24 13:51:33.069196 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: [pid: 133015|app: 0|req: 601/1185] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 13:51:33 2022] DELETE /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:51:33.074334 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-65172d07-1627-467e-9497-6ff3cff7aedd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Calling method '>' {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 13:51:33.074956 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.compute.api [None req-65172d07-1627-467e-9497-6ff3cff7aedd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] [instance: 31b97d61-96c0-459d-83c5-ebd1929f344a] Fetching instance by UUID {{(pid=133014) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 13:51:33.081639 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-65172d07-1627-467e-9497-6ff3cff7aedd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:33.082123 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-65172d07-1627-467e-9497-6ff3cff7aedd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:33.082563 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-65172d07-1627-467e-9497-6ff3cff7aedd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:33.083253 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-65172d07-1627-467e-9497-6ff3cff7aedd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Acquiring lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 13:51:33.083797 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-65172d07-1627-467e-9497-6ff3cff7aedd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 13:51:33.084251 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG oslo_concurrency.lockutils [None req-65172d07-1627-467e-9497-6ff3cff7aedd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Lock "61617dbb-81a0-4cba-8ce2-26c27e8678f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 13:51:33.097473 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.wsgi [None req-65172d07-1627-467e-9497-6ff3cff7aedd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] HTTP exception thrown: Instance 31b97d61-96c0-459d-83c5-ebd1929f344a could not be found. Aug 24 13:51:33.099002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-65172d07-1627-467e-9497-6ff3cff7aedd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Request method failure captured: Aug 24 13:51:33.099002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: request: GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a HTTP/1.1 Aug 24 13:51:33.099002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept: application/json Aug 24 13:51:33.099002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Accept-Encoding: identity Aug 24 13:51:33.099002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Connection: close Aug 24 13:51:33.099002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Length: 0 Aug 24 13:51:33.099002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Content-Type: application/json Aug 24 13:51:33.099002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Host: 10.222.0.73 Aug 24 13:51:33.099002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Openstack-System-Scope: None Aug 24 13:51:33.099002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: User-Agent: python-urllib3/1.26.11 Aug 24 13:51:33.099002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Auth-Token: gAAAAABjBiun8tRbmHUQlTvPsq0siqqif48jOsDdj4o2BD4YZmoAlygMRcO5ZOG2Xy6PhfGG1n2NHjjMXQBmY9DHIN1Lz1pc8opCxWP352OrPSpRmJgqimJUOV5mt4gdxyQ_BKwobp4cAsGPyCUfnIpbfIabYe7pVR9W7JQuxAFYqucb8L0Xgl8 Aug 24 13:51:33.099002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Id: None Aug 24 13:51:33.099002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Domain-Name: None Aug 24 13:51:33.099002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Identity-Status: Confirmed Aug 24 13:51:33.099002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Is-Admin-Project: True Aug 24 13:51:33.099002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Id: default Aug 24 13:51:33.099002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Domain-Name: Default Aug 24 13:51:33.099002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Id: ca298d9092ad4a9489f1624d62b2ac1d Aug 24 13:51:33.099002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Project-Name: tempest-AttachVolumeTestJSON-433341070 Aug 24 13:51:33.099002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Role: member,reader Aug 24 13:51:33.099002 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Roles: member,reader Aug 24 13:51:33.100572 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ca298d9092ad4a9489f1624d62b2ac1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ca298d9092ad4a9489f1624d62b2ac1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ca298d9092ad4a9489f1624d62b2ac1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ca298d9092ad4a9489f1624d62b2ac1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 24 13:51:33.100572 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant: tempest-AttachVolumeTestJSON-433341070 Aug 24 13:51:33.100572 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Id: ca298d9092ad4a9489f1624d62b2ac1d Aug 24 13:51:33.100572 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-Tenant-Name: tempest-AttachVolumeTestJSON-433341070 Aug 24 13:51:33.100572 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User: tempest-AttachVolumeTestJSON-433341070-project Aug 24 13:51:33.100572 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Id: default Aug 24 13:51:33.100572 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Domain-Name: Default Aug 24 13:51:33.100572 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Id: 33835c5512df4c80a9b7cb9712a5904f Aug 24 13:51:33.100572 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: X-User-Name: tempest-AttachVolumeTestJSON-433341070-project Aug 24 13:51:33.100572 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: method: > Aug 24 13:51:33.100572 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: exception: Instance 31b97d61-96c0-459d-83c5-ebd1929f344a could not be found. Aug 24 13:51:33.100572 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: action_args: {'id': '31b97d61-96c0-459d-83c5-ebd1929f344a'} Aug 24 13:51:33.101340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: {{(pid=133014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 13:51:33.101340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:51:33.101340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 13:51:33.101340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 13:51:33.101340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 13:51:33.101340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 13:51:33.101340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 13:51:33.101340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 13:51:33.101340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 13:51:33.101340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 13:51:33.101340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31b97d61-96c0-459d-83c5-ebd1929f344a could not be found. Aug 24 13:51:33.101340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:51:33.101340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:51:33.101340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:51:33.101340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:51:33.101340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:51:33.101340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:51:33.101340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 13:51:33.101340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 13:51:33.101340 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 13:51:33.102601 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 13:51:33.102601 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 13:51:33.102601 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 13:51:33.102601 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 13:51:33.102601 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 13:51:33.102601 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 13:51:33.102601 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 13:51:33.102601 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31b97d61-96c0-459d-83c5-ebd1929f344a could not be found. Aug 24 13:51:33.102601 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:51:33.102601 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 13:51:33.102601 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:51:33.102601 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 13:51:33.102601 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 13:51:33.102601 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 13:51:33.102601 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 13:51:33.102601 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 13:51:33.102601 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31b97d61-96c0-459d-83c5-ebd1929f344a could not be found. Aug 24 13:51:33.102601 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: ERROR nova.api.openstack.wsgi Aug 24 13:51:33.103712 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: DEBUG nova.api.openstack.wsgi [None req-65172d07-1627-467e-9497-6ff3cff7aedd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] Returning 404 to user: Instance 31b97d61-96c0-459d-83c5-ebd1929f344a could not be found. {{(pid=133014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 13:51:33.103712 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO nova.api.openstack.requestlog [None req-65172d07-1627-467e-9497-6ff3cff7aedd tempest-AttachVolumeTestJSON-433341070 tempest-AttachVolumeTestJSON-433341070-project] 10.222.0.73 "GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a" status: 404 len: 111 microversion: 2.1 time: 0.030300 Aug 24 13:51:33.103712 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: [pid: 133014|app: 0|req: 585/1186] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 13:51:33 2022] GET /compute/v2.1/servers/31b97d61-96c0-459d-83c5-ebd1929f344a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 13:51:54.100997 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:51:54.101728 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Wed Aug 24 13:51:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:53:51.557806 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:53:51.563399 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Wed Aug 24 13:53:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:54:09.108893 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:54:09.109522 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Wed Aug 24 13:54:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:55:11.415249 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:55:11.416014 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Wed Aug 24 13:55:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:55:14.109829 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:55:14.110425 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Wed Aug 24 13:55:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:55:20.860057 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:55:20.860589 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Wed Aug 24 13:55:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:57:04.675593 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:57:04.676257 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Wed Aug 24 13:57:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:57:11.567557 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:57:11.568208 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Wed Aug 24 13:57:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:57:29.117079 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:57:29.117701 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Wed Aug 24 13:57:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:58:31.424385 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:58:31.425154 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Wed Aug 24 13:58:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:58:34.117757 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:58:34.118322 dv-cinder-779578-4-iscsi devstack@n-api.service[133014]: Wed Aug 24 13:58:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 13:58:40.868027 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 13:58:40.868507 dv-cinder-779578-4-iscsi devstack@n-api.service[133015]: Wed Aug 24 13:58:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!